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Abstract 



An apparatus (100) for transcoding a coded moving picture sequence according to the present 
invention comprises a rate controller (110) for adapting the scaling factor to perform the rate control 
over the coded moving picture sequence signal having a desired target bit rate. The rate controller 
(110) of the apparatus has: a remaining bit computing unit (101) for computing: a remaining number of 
inputting bits Rin(n) for each of the pictures pic(n) in the first coded moving picture sequence signal b1 
on the basis of the number of real inputting bits Sin(n) of the current picture pic(n) and the estimated 
number of inputting bits; and a remaining number of outputting bits Rout(n) for each of the pictures pic 
(n) in the second coded moving picture sequence signal b2 on the basis of the number of real 
outputting bits Sout(n) of the current picture pic(n) and the estimated number of outputting bits; a target 
ratio computing unit (103) for computing, for each of the pictures pic(n), a target ratio ioRatio(n) of the 
remaining number of outputting bits Rout(n) to the remaining number of inputting bits of the picture Rin 
(n); and a scaling factor computing unit (105, 107) for computing the scaling factor (Q2(j), QM) on the 
basis of the target ratio ioRatio(n) to control the target bit rate of the second coded moving picture 
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sequence signal b2. L_J 
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BACKGROUND OF THE INVENTION 



1. Field of the Invention 



[0001] The present invention relates to an apparatus, method and computer program product for transcoding a 
coded moving picture sequence, and more particularly, to an apparatus, method and computer program product 
for converting a first coded moving picture sequence signal in the form of bit streams transmitted at a first bit rate 
into a second coded moving picture sequence signal in the form of bit streams transmitted at a second bit rate 
lower than the first bit rate by adapting a quantization parameter to perform the effective real timely rate control 
over the second coded moving picture sequence signal with low delay. 



2. Description of the Related Art 



[0002] There has so far been proposed a wide variety of systems for compressing and encoding a moving picture 
having a considerable large data to produce a coded moving picture sequence signal. The international standard, 
ISO-IEC 13818-2, was created for a system operable to encode a digital video signal associated with a digital 
audio signal and commonly called "Moving Picture Expert Group Phase 2", i.e., "MPEG-2". In such encoding 
system, the coded moving picture sequence signal is outputted in the form of bit streams. In particular, the bit 
streams conformable to above MPEG-2 standard will be referred to as "MPEG-2 bit streams" hereinlater. 
Recently, the system of this type becomes more utilizable for various technical fields, such as a communicating 
system, a television broadcasting system, and so on. 

[0003] The above MPEG-2 bit streams have a hierarchical structure consisting of: in turn, a top, sequence layer; a 
GROUP OF PICTURES layer; a picture layer, a slice layer, a macroblock layer, and a low, block layer. 

[0004] According to the MPEG-2 standard, a typical encoder is operable to employ the following method of 
compressing and encoding a moving picture. The method comprises the steps of: 

(a) inputting the moving picture sequence consisting of a series of pictures; 

(b) temporally storing the pictures as frames in memories, respectively; 

(c) computing a difference between one frame and another frame to eliminate redundancy in a time axis direction; 
and 

(d) orthogonal transforming, e.g., discrete cosine transforming (DCT), a plurality of picture elements within each of 
the frames to eliminate redundancy in a spatial axis direction. 



[0005] The encoder thus constructed can compress and encode the moving picture to generate and output the 
coded moving picture sequence signal in the form of the MPEG-2 bit streams through a transmitting path at a 
predetermined bit rate. The coded signal is then transmitted from the encoder to a decoder which is adapted to 
decode the coded signal to reproduce the moving picture. The typical decoder is operated to employ so-called bi- 
directionally predicting method which comprises the steps of: 

(a) storing one reproduced picture, generally referred to as "intra-picture", i.e., "l-picture", in a first frame memory; 

(b) estimating another picture generally referred to as "predictive-picture", i.e., "P-picture", followed by the I- 
picture, on the basis of the information on a difference between l-picture and P-picture; 

(c) storing the estimated picture in a second frame memory; and 

(d) estimating further another picture interposed between the l-picture and P-picture, generally referred to as "bi- 
directionally predictive-picture", i.e., "B-picture". 



[0006] Here, the l-picture is encoded independently of the other types of pictures, so that the l-picture can be 
reproduced as a static image only by itself. The P-picture can be predicted on the basis of the l-picture or P- 
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picture located on a position prior to this P-picture to be encoded. 

[0007] In the above encoder, the volume of information on the coded moving picture sequence signal is, however, 
variable, in particularly, remarkably increased in accordance with a change of scene. The decoder is generally 
provided with an input buffer for receiving the coded moving picture sequence signal from the encoder. The input 
buffer of the decoder, however, has a limited storage capacity. Therefore, when a large number of bits of the 
coded moving picture sequence signal is transmitted from the encoder to the decoder, the input buffer overflows 
with the large number of bits of the coded moving picture sequence signal thereby making the decoder haul to 
process the coded moving picture sequence signal. In order to transmit such coded moving picture sequence 
signal having a variable volume of information on the transmitting path at a predetermined invariable bit rate and 
to enable any decoders to receive the coded moving picture sequence signal, the encoder comprises: an output 
buffer for temporally storing the coded moving picture sequence signal before transmitting the coded moving 
picture sequence signal on the transmitting path; and a rate controller for controlling the volume of information on 
the coded moving picture sequence signal stored in the output buffer so as to keep the volume of information on 
the coded moving picture sequence signal from exceeding the volume of the buffer and then to control the bit rate 
of the coded moving picture sequence signal. 

[0008] A typical rate controlling method in MPEG-2 standard is described in "1SO-IEC/JTC1/SC29/WG11/N0400 
Test Model 5", April, 1993, hereinlater referred to as "TM-5". According to the TM-5, the rate controlling method 
comprises the steps of: 

(I) allocating a target bit by estimating the number of bits available to code the next picture before coding the 
current picture; 

(li) computing the reference value of the quantization parameter used for the quantization of each of macroblocks 
in the current pictures by means of a "virtual buffer" to perform the rate control; and 

(111) modulating the reference quantization parameter in accordance with the spatial activity in the macroblock. 



[0009] Furthermore, there are many types of decoders, for instance, one is designed to decode the coded signal 
having a specific format different from that of MPEG-2 bit streams, and another is connectable to a transmitting 
path having a different bit rate. These types of decoders are therefore required to provide with an apparatus, so- 
called transcoder, for converting a bit rate of the MPEG-2 bit streams into another appropriate coded moving 
picture sequence signal. The coded moving picture sequence signal can be transmitted to any types of decoders 
from the encoder via an appropriate transcoder. 

[0010] Referring to FIG. 13 of the drawings, there is shown one typical type of the conventional transcoders as a 
first conventional transcoder 50. The conventional transcoder 50 has an input terminal a1 electrically connected to 
a first transmitting path, not shown, and an output terminal a2 electrically connected to a second transmitting path, 
not shown. The conventional transcoder 50 is designed to input first bit streams b1 at a predetermined input bit 
rate through the input terminal al, to convert the first bit streams b1 into second bit streams b2 to be output at a 
predetermined output bit rate, i.e., a target bit rate, lower than the input bit rate of the inputted first bit streams b1, 
and to then output the second bit streams b2 through the output terminal a2. The conventional transcoder 50 
comprises a variable length decoder 51, referred to as "VLD" in the drawings, a de-quantizer 53, referred to as 
"IQ" in the drawings, a quantizer 55, referred to as "Q" in the drawings, a variable length encoder 57, referred to 
as "VLC" in the drawings, and a rate controller 59. 

[001 1] The variable length decoder 51 is electrically connected to the input terminal a1 and designed to decode a 
coded moving picture sequence signal within the first bit streams b1 inputted through the input terminal a1 to 
reconstruct an original picture data for each of pictures including a matrix of original quantization coefficients, 
referred to as "level", for each of macroblocks within each of the pictures and an original quantization parameter, 
hereinlater referred to as "first quantization parameter Q1". 

[0012] The de-quantizer 53 is electrically connected to the variable length decoder 51 and designed to input the 
matrix of original quantization coefficients level from the variable length decoder 51 and the first quantization 
parameter Q1 . The de-quantizer 53 is further designed to inversely quantize the inputted matrix of original 
quantization coefficients level with the first quantization parameter Q1 to generate a matrix of de-quantization 
coefficients, referred to as "dequant", i.e., DCT coefficients, for each of macroblocks as follows: 
"equation (1)" dequant = {2 x level + sign(level)} x Q1xQM DIVIDED 32 
or 

"equation (2)" dequant = level x Q1xQM DIVIDED 16 

where the equation (1 ) is used for the inter macroblock, while the equation (2) is used for the intra macroblock. 
QM is a matrix of quantization parameters stored in a predetermined quantization table. The first quantization 
parameter Q1 and the matrix of quantization parameters QM are derived from the inputted first bit streams b1 by 
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the decoder 51. Here, the original quantization coefficients level, the de-quantization coefficients dequant, the 
matrix of quantization parameters QM, and the first quantization parameter Q1 are integers. The de-quantization 
coefficients dequant calculated by the equations (1) and (2) should be rounded down to the nearest one. 

[0013] The quantizer 55 is electrically connected to the de-quantizer 53 and designed to input the matrix of de- 
quantization coefficients dequant from the de-quantizer 53 and then quantize the inputted matrix of de- 
quantization coefficients dequant for each of macroblocks with a second quantization parameter, referred to as 
n Q2" hereinlater, to generate a matrix of re-quantization coefficients, referred to as "tlevel" as follows* 
"equation (3)" tlevel = dequant x 16 DIVIDED Q2xQM 
or 

"equation (4)" tlevel = dequant x 16 DIVIDED Q2xQM + sign(dequant) x 1 DIVIDED 2 

where the equation (3) is used for the inter macroblock, while the equation (4) is used for the intra macroblock 
The second quantization parameter Q2 is obtained by the rate controller 59. Here, the re-quantization coefficients 
tlevel and the second quantization parameter Q2 are also integers. The re-quantization coefficients tlevel 
calculated by the equations (3) and (4) should be rounded down to the nearest one. Such rounding operation for 
the integers will be omitted from the later description for avoiding tedious repetition. 

[0014] The variable length encoder 57 is electrically connected to the quantizer 55 and designed to input the re- 
quantization coefficients tlevel from the quantizer 55 and then encode the inputted matrix of the re-quantization 
coefficients tlevel to generate an objective picture data for each of pictures to sequentially output the objective 
picture data in the form of the second bit streams b2 through the output terminal a2. The variable length encoder 
57 is further electrically connected to the variable length decoder 51 and designed to input a diversity of 
information included in the first bit streams b1 necessary for the second bit streams b2 from the variable length 
decoder 51. 

[0015] The rate controller 59 is electrically connected to the de-quantizer 53 and designed to perform a rate 
control over the encoding in the conventional transcoder 50 according to the TM-5 on the basis of the information 
obtained from the de-quantizer 53 as described below. 

[0016] Referring to FIG. 14 of the drawings, there is shown a flowchart of the rate controlling process according to 
TM-5 in the conventional transcoder 50. As shown in FIG. 14, the rate controlling process comprises steps A1 to 
A14. 

[0017] In the step A1, "1" is assigned to the picture number variable n representing a serial number of pictures 
within the first bit streams b1. Hereinlater, the n-th picture in the first bit streams b1 is referred to as "pic(n)". 

[0018] In the following step A2, a global complexity measure Xi, Xp, orXb for the corresponding type of pictures, 
i.e., I, P or B-picture is computed as follows: 
"equation (5)" Xi=SixQi 
or 

"equation (6)" Xp=SpxQp 
or 

"equation (7)" Xb=SbxQb 

where Si, Sp, or Sb is the number of bits generated by encoding I, P or B-picture, and Qi, Qp, or Qb is the 
average quantization parameter computed by averaging the actual quantization values used during the 
quantization of the all macroblocks within I, P or B-picture. The average quantization parameters Qi, Qp, and Qb 
are normalized within a range of 1 to 31. The average quantization parameters Qi, Qp, and Qb respectively 
correspond to the first quantization parameters Q1 obtained from the variable length decoder 51 . 

[0019] The global complexity measure Xi, Xp, or Xb of the corresponding picture is inversely proportional to the 
compressing ratio of the moving picture, namely, a ratio of the volume of information in the second bit streams b2 
to that in the first bit streams b1 . Namely, as the volume of information on the first bit streams b1 becomes larger, 
the compressing ratio is decreased. Therefore, the global complexity measure Xi, Xp, or Xb of the corresponding' 
picture becomes larger, as the compressing ratio is decreased. In contrast, the global complexity measure Xi, Xp, 
or Xb of the corresponding picture becomes smaller, as the compressing ratio is increased. 

[0020] The initial value of global complexity measure Xi, Xp, or Xb of the corresponding picture is given as 
follows: 

"equation (8)" Xi=160xTargetJ3itrate/115 
or 

"equation (9)" Xp=60xTarget_Bitrate/115 
or 

"equation (10)" Xb=42xTarget_Bitrate/1 15 
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where Target_Bitrate is measured in bits/s and corresponds to the target bit rate of the first conventional 
transcoder 50. 

[0021] In the following step A3, the target number of bits for the next picture in the current GROUP OF PICTURES 
Ti, Tp, or Tb is computed as; 



where Np and Nb are the remaining number of P-pictures and B-pictures, respectively, remaining the current 
GROUP OF PICTURES in the encoding order. Kp and Kb are universal constants dependent on the quantization 
matrices. When it is assumed that Kp=1.0 and Kb=1.4, the quality of the image can be always optimized. 

[0022] In the following step A4, the judgment is made whether the picture number variable n is "1" or not, i.e., the 
current picture is the first picture pic(1) or not When the answer is "YES", i.e., the current picture is the first 
picture pic(1), the step A4 goes to the step A5. When, on the other hand, the answer is "NO", i.e., the current 
picture is not the first picture, the step A4 goes to the step A6. in the step A5, the remaining number of bits 
assigned to the GROUP OF PICTURES R is initialized according to the following equation (14). This remaining 
number of bits assigned to the GROUP OF PICTURES R is computed before encoding the first pictures pic(1) 
within the GROUP OF PICTURES, i.e., an 1-picture, as follows: 

where NPIC is the total number of pictures in each of the GROUP OF PICTURES, and picturej-ate is expressed 
in the number of decoded pictures per second. At the start of the sequence R=0. 

[0023] In the step A6, the above remaining number of bits assigned to the GROUP OF PICTURES R is updated 
before encoding the current picture pic(n) as follows: 
"equation (15)" R=R-Si 
or 

"equation (16)" R=R-Sp 
or 

"equation (17)" R=R-Sb 

where Si, Sp, or Sb is the number of bits generated in the previous picture pic(n-1) of the corresponding type (I, P 
or B) just encoded. 

[0024] The step A5 or A6 goes to the step A7 wherein "1" is assigned to the macroblock number variable j G >= 1) 
representing a serial number of macroblocks within one of the pictures. Hereinlater the j-th macroblock in the 
picture is referred to as "MB(j) n . 

[0025] In the following step A8, the fullness of appropriate virtual buffer di(j), dp(j) or db(j) is computed depending 
on the picture type before encoding macroblock MB(j) as follows: 
"equation (18)" di(j) = di(0) + BQ-1) -TixQ-1) DIVIDED NMB 
or 

"equation (19)" dpG) = dp(0) + BQ-1) - TpxQ-1) DIVIDED NMB 
or 

"equation (20)" db (j) = db (0 + B(j -1) - Tbx(j-1) DIVIDED NMB 

where B(j-1) is the number of bits generated by encoding ail macroblocks in the picture up to including (j-1)th 
macroblock MB(j-1). NMB is the total number of macroblocks in the picture. di(j), dp(j), or db(j) is a fullness of 
virtual buffer at the j-th macroblock MB(j) for I, P, or B-picture. 

[0026] di(0), dp(0), or db(0) is an initial fullness of virtual buffer for I, P, or B-picture and given by: 

"equation (21)" di(0)=10xr/31 

or 

"equation (22)" dp(0)=Kpxdi(0) 
or 

"equation (23)" db(0)=Kbxdi(0) 

where r is referred to as "reaction parameter" and used for the control of a reaction rate of the loop of feed back 
as follows; 

"equation (24)" r=2xTarget_Bitrate/picture_rate 



[0027] The final fullness of the virtual buffer di(NMB), dp(NMB), or db(NMB) of the NMB-th macroblock MB(NMB) 
of the current picture pic(n) is used as di(0), dp(0), or db(0) for encoding the first macroblock MB(1) within the next 
picture pic(n+1) of the same type. 
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[0028] In the following step A9, the reference quantization parameter Q(j) for the j-th macroblock MB(j) in each of 
pictures is computed on the basis of the above virtual buffer fullness d(i) as follows- 
"equation (25)" Q(j)=d(j)x31/r ' 



parameterQ^ 6 reference °l uantization Parameter Q(j) is identical with the aforesaid second quantization 

[0030] In the following step A10, the j-th macroblock MB(j) is quantized with the reference quantization parameter 
QO) computed in the step A9. In the following step A1 1 , the macroblock number variable j is incremented by 1 
The step A 11 goes to the step A12 wherein the judgment is made whether the macroblock number variable i is 
more than the total number of macroblocks NMB within the n-th picture pic(n) or not When the answer is "NO" 
i.e., the macroblock number variable] is less than the total number of macroblocks NMB, the control is returned 
from the step A12 to the step A8^ When, on the other hand, the answer is "YES", i.e., the maczoblock number 
variable j exceeds the total number of macroblocks NMB, the step A12 goes to the step A13. " umD er 

[0031] The macroblock number variable j thus serves as a loop counter for repeating the steps A8 to A1 1 to 
encode all the macroblocks MB(j) in the present picture pic(n). The entire macroblocks the first macroblork MRm 
up to the NMB-th macroblock MB(NMB), in the n-th picture pic(n) can be thus encoded in turn maCr ° b '° ck MB(1 ) 

L°P? 2 l ln the step A1 3 ' the picture number variable n is incremented by 1 . Then the step A1 3 qoes to the steo 
A14 wherein the judgment is made whether the picture number variable n is more than the total number of 

ESS Z\r V 01 T?" th ! anS TT iS " N .°"' i e ' the picture number variable n is less tnan t"e total number of 
pictures NP C, the control .s returned from the step A14 to the step A2. When, on the other hand, the answer is 
YES i.e., the picture number variable n exceeds the total number of pictures NPIC, this routine of the rate 
controHmg process is terminated. The picture number variable n thus serves as a loop counter for repeating the 
steps A2 to A13 to process all the pictures pic(n) in the present GROUP OF PICTURE. The entire pictures the 
first pictures p.c(1) up to the NPIC-th picture pic(NPIC), in the present GROUP OF PICTURE can be therefore 
processed in turn. cluie 

K™ll™ af ° resaid conventional transcoder 50, however, has no information on the structure of GROUP OF 
PICTURES, such as a picture rate of I or P-pictures within each of the GROUP OF PICTURES so that the 
TJ^^iZV S !!? ate ^.sfucture of GROUP OF PICTURES within the inputted moving picture sequence 
to allocate bits for each type of pictures within the estimated structure of GROUP OF PICTURES 

[0034] | Furthermore, the first conventional transcoder 50 is required to decode the first bits streams b1 almost all 
over the layers such as the sequence layer, the GROUP OF PICTURES layer, the picture layer, the slice layer 
and the macroblock layer in order to derive necessary data for transcoding from the first bits streams b1 This ' 
operation wastes time, thereby causing the delay in the transcoding process. 

[0035] Referring to FIG. 15 of the drawings, there is shown an example of the improvement of the above 
transcoder 50 as a second conventional transcoder 60. The second conventional transcoder 60 is adapted to 
perform the rate control without estimating the structure of GROUP OF PICTURES As shown in FIG 15 the 
second conventional transcoder 60 comprises a delay circuit 61 and a rate controller 62 in addition to the variable 
length decoder 51, the de-quantizer 53, the quantizer 55 and the variable length encoder 57 same as those of the 
first conventional transcoder 50 shown in FIG. 13. These same constitutional elements are simply represented bv 
the same reference numerals as those of the conventional transcoder 50, and will be thus omitted from 
description for avoiding tedious repetition. 

[0036] The delay circuit 61 is interposed between the variable length decoder 51 and the de-quantizer 53 and 
designed to control the flow of the signal from the variable length decoder 51 to the de-quantizer 53 The delay 
circuit 61 is operated to delay starting the de-quantizing process in the de-quantizer 53 until the variable lenqth 
decoder 51 has been finished to decode one of the pictures in the coded moving picture sequence signal. 

[0037] As shown in FIG. 15, the rate controller 62 of the second conventional transcoder 60 includes a target ratio 
computing unit 63, an input bit summing unit 65, a bit difference computing unit 67, a target output bit updatina 
unit 69, and a quantization parameter computing unit 71 . " 

[0038] The target ratio computing unit 63 is electrically connected to the variable length decoder 51 and designed 
to input an input bit rate of the first bit streams b1 , hereinlater referred to as "lnput_Bitrate" from the variable 
length decoder 51, and input a target bit rate, hereinlater referred to as "Target_Bitrate" through a terminal a3 
Alternatively, the target bit rate Target_Bitrate may be previously stored in an internal memory, or determined on 
the basis of internal switches. The target ratio computing unit 63 is designed to then compute a target ratio 
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(ioRatio) of the target bit rate Target_Bitrate to the input bit rate lnputJ3itrate for each of pictures as follows, 
"equation (26)" ioRatio = Target_Bitrate DIVIDED lnput_Bitrate 



[0039] The input bit summing unit 65 is designed to sum the number of inputting bits of the picture decoded by the 
variable length decoder 51 to produce the total number of inputting bits Tin. On the other hand, the target output 
bit updating unit 69 is designed to compute a target number of outputting bits Tout to be generated by the variable 
length encoder 57. The target number of outputting bits Tout is computed by multiplying the total number of 
inputting bits Tin by the target ratio ioRatio as follows: 
"equation (27)" Tout=TinxioRatio 



[0040] The bit difference computing unit 67 is electrically connected to the variable length encoder 57 and the 
target output bit updating unit 69, and designed to input a real number of outputting bits Treal encoded by the 
variable length encoder 57 and input the target number of outputting bits Tout. The bit difference computing unit 
67 is designed to then compute a difference number of bits Tdiff between the target number of outputting bits Tout 
and the real number of outputting bits Treal as follows: 
"equation (28)" Tdiff=Treal-Tout 



[0041] The target output bit updating unit 69 is electrically connected to the target ratio computing unit 63, the 
input bit summing unit 65, and the bit difference computing unit 67. The target output bit updating unit 69 is 
designed to update the target number of outputting bits Tout on the basis of the difference number of bits Tdiff as 
follows: 

"equation (29)" Tout=Tout-Tdiff 



[0042] The quantization parameter computing unit 71 is electrically connected to the target output bit updating unit 
69 and designed to compute the reference quantization parameter Q(j) for each of macroblocks MB(j) on the 
basis of the target outputting bits Tout updated by the target output bit updating unit 69 in accordance with the 
steplloftheTM-5. 

[0043] FIG. 16 shows the flowchart of the rate controlling process performed by the above conventional 
transcoder 60. The rate controlling process in the transcoder 60 comprises the steps B1 to B13. The steps B6 to 
B13 are the almost same as those of the steps A7 to A14, respectively, in the rate controlling process shown in 
FIG. 14 except for the step B7 wherein the virtual buffer fullness is computed on the basis of the target number of 
outputting bits Tout given by the target output bit updating unit 69 instead of the target number of bits Ti, Tp or Tb 
obtained in the step A3 shown in FIG. 14. These same steps will be thus omitted from description for avoiding 
tedious repetition. 

[0044] In the step B1 , "1" is assigned to the picture number variable n. The step B1 then goes to the step B2 
wherein the target ratio ioRatio is computed by the above equation (26). In the following step B3, the difference 
number of bits Tdiff is computed for the present picture pic(n) by the above equation (28). The step B3 then goes 
to the step B4 wherein the number of inputting bits Tin are summed up within the first bit streams b1. In the step 
B5, the target number of outputting bits Tout is computed by the above equation (27), and further updated by the 
above equation (29). 

[0045] In the second conventional transcoder 60 thus constructed, the de-quantizer 53, however, must wait until 
the decoding process of the picture has been completed over the entire target transcoding frame, thereby causing 
the delay in the transcoding process. 

[0046] Referring to FIGS. 17 and 18 of the drawings, there is shown another example of improvement of the 
above transcoder 50 as a third conventional transcoder 80. The third conventional transcoder 80 is also adaptable 
to perform the rate control without estimating the structure of GROUP OF PICTURES. As shown in FIG. 17, the 
third conventional transcoder 80 comprises an input terminal a1 electrically connected to a first transmitting path 
and designed to input an input bit streams b3 at the input bit rate, and an output terminal a2 electrically connected 
to a second transmitting path and designed to output an output bit streams b4 at the target bit rate. In the third 
conventional transcoder 80, the input bit streams b3 have a format, non-adaptable for the MPEG-2, different from 
that of the bit streams b1 of the first and second conventional transcoders 50 and 60. The input bit streams b3 
have information on the number of coding bits previously recorded thereon by the encoder, not shown. 

[0047] The third conventional transcoder 80 comprises a variable length decoder 81 electrically connected to the 
input terminal a1 , and a rate controller 82 in addition to the de-quantizer 53, the quantizer 55, the variable length 
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encoder 57 which are same as those of the second transcoder 60 shown in FIG. 13. The rate controller 82 
includes a target output bit updating unit 83, and a quantization parameter computing unit 85 in addition to the 
target ratio computing unit 63, and the bit difference computing unit 67 which are same as those of the second 
transcoder 60 shown in FIG. 15. 

[0048] The third conventional transcoder 80 thus constructed can perform the rate control on the basis of the 
formation on the number of coding bits previously recorded in the input bit streams b3. The variable length 
decoder 81 is adapted to decode the pictures in the coded moving picture sequence signal within the third bit 
streams b3 to obtain the information on the number of coding bits and transmit this information to the de-quantizer 
53. The variable length decoder 81 is also adapted to transmit the number of inputting bits Tin to the target output 
bit updating unit 83. 

[0049] The outputting bit updating unit 83 is designed to compute the target number of outputting bits Tout is 
computed on the basis of the number of inputting bits Tin and the target ratio ioRatio by the above equation (26). 
The quantization parameter computing unit 85 is designed to compute the reference quantization parameter Q(j) 
for each of the macroblocks MB(j) on the basis of the target number of outputting bits Tout updated by the 
outputting bit updating unit 83 according to the step II in the TM-5. The quantizer 55 is then operated to quantize 
the j-th macroblock MB(j) on the basis of the reference quantization parameter Q(j) given by the quantization 
parameter computing unit 85. 

[0050] FIG. 18 shows the flowchart of the rate controlling process performed by the above third conventional 
transcoder 80. The rate controlling process in the transcoder 80 comprises the steps C1 to C13. All the steps C1 
to C13 are the same as those of the steps B1 to B13, respectively, in the rate controlling process shown in FIG. 
16 except for the step C4 wherein the information on the number of inputting bits Tin in the current picture pic(n) 
is derived from the third bit streams b3 by the decoder 81 to obtain the total number of inputting bits Tin. 

[0051] The third conventional transcoder 80 thus constructed has information on the number of coding bits 
previously recorded in the third bits streams b3 thereby making it possible to solve the problem of the delay in the 
second conventional transcoder 60. The third conventional transcoder 80, however, has another problem to 
restrict the form of the inputted bit streams. Moreover, the encoder which is linked with the third transcoder 80 
must provide with the above information on the number of coding bits to be recorded in the bit streams, thereby 
causing the delay of process in the encoder. 

[0052] In the any conventional transcoders 50, 60 and 80, the matrix of the de-quantization coefficients dequant is 
necessary for only the quantizer 55, but unnecessary for the transcoder itself to generate the desired bit streams. 
In order to eliminate the redundant matrix of the de-quantization coefficients dequant, there is proposed a fourth 
conventional transcoder 90 comprising a level converter 91 instead of the de-quantizer 53 and the quantizer 55 of 
the transcoder 50, as shown in FIG. 19. 

[0053] The level converter 91 is interposed between the variable length decoder 51 and the variable length 
encoder 57. The level converter 91 is designed to input the original picture data for each of pictures. The original 
picture data includes a matrix of original quantization coefficients level for each of macroblocks within the 
corresponding picture. The level converter 91 is electrically connected to the rate controller 59 and designed to 
input the second quantization parameter Q2 from the rate controller 59. 

[0054] The level converter 91 is further designed to convert the original picture data for each of pictures including 
the matrix of original quantization coefficients level into the objective picture data including the matrix of re- 
quantization coefficients tlevel without generating the matrix of the de-quantization coefficients dequant. The 
following equations (30) and (31) for the matrix of re-quantization coefficients tlevel are lead by eliminating the 
matrix of the de-quantization coefficients dequant from the above equations (1), (2), (3) and (4). 
"equation (30)" tlevel = (level + sign(level) x 1 DIVIDED 2 x Q1 DIVIDED Q2 
or 

"equation (31)" tlevel = level x 1 DIVIDED 2 x Q1 DIVIDED Q2 + sign(level) DIVIDED 2 

where the above equation (30) is used for the inter macroblock, while the above equation (31) is used for the intra 
macroblock. The level converter 91 is thus operable to convert the original picture data, for each of pictures, into 
the second pictures data with the first quantization parameter Q1 and the second quantization parameter Q2. The 
first quantization parameter Q1 is decoded from the first bit streams b1 by the variable length decoder 51 , while 
the second quantization parameter Q2 is obtained from the rate controller 59. 

[0055] In the fourth conventional transcoder 90, the rate controller 59 is designed to perform the rate control over 
the encoding in the transcoder 90 according to the TM-5. The variable length encoder 57 is electrically connected 
to the level converter 91 and to input the above matrix of re-quantization coefficients tlevel from the level 
converter 91. 
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[0056] The fourth conventional transcoder 90 thus constructed can efficiently perform the transcoding process at 
high speed without storing the matrix of de-quantization coefficients dequant in a memory. 

[0057] The above conventional transcoders 50, 60, 80 and 90, however, has another problem with the rate- 
distortion performance In converting the quantization level. The detailed description of this problem will be made 
later. In short, the rate-distortion performance in converting the quantization level is unstable and variable in 
accordance with the first and second quantization parameters and the level of the original quantization 
coefficients level. Therefore, as the reduced information volume becomes larger, the quantization error is liable to 
increase, thereby causing the unstable rate control in transcoding. 



SUMMARY OF THE INVENTION 



[0058] It is therefore an object of the present invention to provide a method of transcoding a coded moving picture 
sequence in which there is no need of information excluded from the coded moving picture sequence and no 
limitation in the form of the coded moving picture sequence prepared by the encoder in order to real timely and 
effectively reduce the bit rate of the coded moving picture sequence with low delay. 

[0059] It is another object of the present invention to provide a method of transcoding a coded moving picture 
sequence in which it is possible to reduce the quantization error as well as to increase the reduced information 
volume. Therefore, the above method can achieve the appropriate rate control. 

[0060] It is further object of the present invention to provide an apparatus for transcoding a coded moving picture 
sequence in which there is no need of information excluded from the coded moving picture sequence and no 
limitation in the form of the coded moving picture sequence prepared by the encoder in order to real timely and 
effectively reduce the bit rate of the coded moving picture sequence with low delay. 

[0061] It is also object of the present invention to provide an apparatus for transcoding a coded moving picture 
sequence in which it is possible to reduce the quantization error as well as to increase the reduced information 
volume. Therefore, the above apparatus can achieve the appropriate rate control. 

[0062] It is a yet object of the present invention to provide a computer program product for transcoding a coded 
moving picture sequence signal in which there is no need of information excluded from the coded moving picture 
sequence signal and no limitation in the form of the coded moving picture sequence signal prepared by the 
encoder in order to real timely and effectively reduce the bit rate of the coded moving picture sequence with low 
delay. 

[0063] It is further yet object of the present invention to provide a computer program product for transcoding a 
coded moving picture sequence signal in which it is possible to reduce the quantization error as well as to 
increase the reduced information volume. Therefore, the above computer program product can achieve the 
appropriate rate control. 

[0064] In accordance with a first aspect of the present invention, there is provided a method of transcoding a 
coded moving picture sequence, comprising the steps of: 

(a) inputting a first coded moving picture sequence signal at an input bit rate, the first coded moving picture 
sequence signal consisting of a series of pictures; 

(b) computing an estimated number of inputting bits to be input in the inputting step (a) for a predetermined 
duration on the basis of the input bit rate of the first coded moving picture sequence signal; 

(c) decoding the first coded moving picture sequence signal inputted in the inputting step (a) to reconstruct an 
original picture data, for each of the pictures, having a number of real inputting bits; 

(d) computing, for each of the pictures, a remaining number of inputting bits after the previous picture in the first 
coded moving picture sequence signal is decoded in the decoding step (c) on the basis of the number of real 
inputting bits of the previous picture and the estimated number of inputting bits obtained in the computing step (b); 

(e) transforming, on the basis of a scaling factor, the original picture data reconstructed in the decoding step (c) 
for each of the pictures into an objective picture data having a number of real outputting bits less than the number 
of real inputting bits of the original picture data; 

(f) encoding the objective picture data obtained in the transforming step (e) to generate a second coded moving 
picture sequence signal; 

(g) outputting the second coded moving picture sequence signal generated in the encoding step (f) at a target bit 
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rate lower than the input bit rate of the first coded moving picture sequence signal; 

(h) computing an estimated number of outputting bits to be output in the outputting step (g) for the predetermined 
duration on the basis of the target bit rate of the second coded moving picture sequence signal; 

(i) computing, for each of the pictures, a remaining number of outputting bits after the previous picture in the 
second coded moving picture sequence signal is encoded in the encoding step (f) on the basis of the number of 
real outputting bits of the previous picture and the estimated number of outputting bits obtained in the computing 
step(h); 

(j) computing, for each of the pictures, a target ratio of the remaining number of outputting bits computed in the 
computing step (i) to the remaining number of inputting bits computed in the computing step (d) before the 
present picture is transformed in the transforming step (e); and 

(k) computing the scaling factor on the basis of the target ratio computed in the target ratio computing step (j) to 
control the target bit rate of the second coded moving picture sequence signal. 



[0065] In the aforesaid method, the computing step (d) may comprise the steps of: 

(d1) initializing the remaining number of inputting bits of the current picture on the basis of the estimated number 
of inputting bits; 

(d2) updating the remaining number of inputting bits of the current picture on the basis of the number of real 
inputting bits of the previous picture and the remaining number of inputting bits of the previous picture; 
(d3) repeating the step (d2) for each of the pictures; and 

(d4) repeating the steps (d1) and (d3) at time intervals of the predetermined duration. Furthermore, the computing 
step (h) may comprise the steps of: 

(hi) initializing the remaining number of outputting bits of the current picture on the basis of the estimated number 
of outputting bits; 

(h2) updating the remaining number of outputting bits of the current picture on the basis of the number of real 
outputting bits of the previous picture and the remaining number of outputting bits of the previous picture; 
(h3) repeating the step (h2) for each of the pictures; and 

(h4) repeating the steps (hi) and (h3) at time intervals of the predetermined duration. 



[0066] Alternatively, the aforesaid method may further comprise the step of repeating the steps (b), (d), (h) and (i) 
for each of the pictures. 

[0067] Alternatively, in the aforesaid method, each of the pictures may consist of a plurality of blocks. 
Furthermore, the decoding step (c) may have the step of deriving an original scaling factor from the first coded 
moving picture sequence signal. The transforming step (e) may comprise the steps of: 

(e1) dividing the original picture data for each of the picture into a plurality of block data respectively 
corresponding to the blocks; 

(e2) quantizing the block data for each of the blocks with the scaling factor, and 

(e3) repeating the steps (e1) and (e2) for each of the blocks within the picture to generate the objective picture 
data. The step (k) may have the step of updating the scaling factor on the basis of the original scaling factor. 



[0068] In accordance with a second aspect of the present invention, there is provided a method of transcoding a 
coded moving picture sequence, comprising the steps of: 

(a) inputting a first coded moving picture sequence signal at an input bit rate, the first coded moving picture 
sequence signal consisting of a series of pictures; 

(b) decoding the first coded moving picture sequence signal inputted in the inputting step (a) to reconstruct an 
original picture data, for each of the pictures, having a number of real inputting bits, and derive an original scaling 
factor; 

(c) transforming, on the basis of a scaling factor, the original picture data reconstructed in the decoding step (b) 
for each of the pictures into an objective picture data having a number of real outputting bits less than the number 
of real inputting bits of the original picture data; 

(d) encoding the objective picture data obtained in the transforming step (c) to generate a second coded moving 
picture sequence signal; 

(e) outputting the second coded moving picture sequence signal generated in the encoding step (d) at a target bit 
rate lower than the input bit rate of the first coded moving picture sequence signal; 

(f) computing a temporary scaling factor on the basis of the reconstructed original picture data to control the target 
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bit rate of the second coded moving picture sequence signal- and " ~ ° 

^^^S^^^^ *P (0 on the basis of the origina, scaiing 

composing: inputting means for inputting a first S movL^S and 3 S6C0nd 'emitting path, 9 
transiting path at an input bit rate, the first coded noSct^e LS" 06 S ' 9 , nal throu 9 h tne first 
pictures; decoding means for decoding the first codeTmovin^ Si « ^ S ' 9nal consisti "9 of a series of 
inputting means to reconstruct an original picture data tofSti^'SS^^ inputted throu 9h the 
bits, transformmg means for transforming, on the teste of a scalina facto? Z^*™? 3 ? Umber of real ^Putting 
by the decoding means for each of the pictures into an objective nichS ^ ^ P ' Cture data reconstructed 
b*s less than the number of real inputting bits of the e^lSSffiSS,?!? T" 9 3 number of real outputting 
objective picture data obtained by the hLhnr^^^^^S^^^ , m ! 3nS for encodin 9 *e 

Sinn tpUttin9 ^ eanS for ° utputtin 9 the second 9 code^ mol p cSre llZn^ T'™ 3 pictu re sequence 
encoding means through the second transmittina Dath It L terli k? » f ec l u ence signal generated by the 

coded moving picture sequence signaf anX S^nJ^ 9 .* b ' f3te '° Wer than the in P ut bit rate of the first 

coded moving picture sequence signal' Te rate com o So means t^T*™ 9 bit rate of th ^cond 

computing: an estimated number of inputting bits ^S^S^L^r mma bit com P utin 9 unit for 

duration on the basis of the input bit rate of the first c?dec mov no PUtt ' ng means for a Predetermined 

inputting bits for each of the pictures in the first oM^^S^SS!^ S 9 n£ * a re ™'™9 number of 

of real inputting bits of the current picture and the estimated ^S^ffiS* u?" 3 ' °" the basis of tne num ber 

outputting bits to be output through the outputting m«^S^irE^'?i ),,8: 3 " 6Stimated number <* 

bit rate o the second coded moving pirture sequent fsfgS ■^ P ?J23Sf dUr3ti ° n 00 the basis of th * target 

of the pictures in the second coded moving picture sequence sianal on thL h 9 TS* of outputtin 9 Mto for each 

bits of the current picture and the estimated number of b^^S"? 5° number of real outputting 

computing, for each of the pictures a taraet ratio nf thl rt^t 9 ' L b) a target ratl ° computing unit for 

remaining bit computing unftto the'remS "^^J^^^^'T^ bits com P^ by the 

computing unit; and (c) a scaling factor computing un t fo Sn.?tin?tSl^ ? ,ctu / e com P ute d by the remaining bit 

set^ 
H:^« 

the basis of the number of real outputtingbits J^f!SSS!^^%^^ bitS of * he current P'Cture on 
of the previous p.cture; initialize the remaining number of innuffina hltfrS J rema,n ' n 9 number of outputting bits 
estimated number of inputting bits at time intervals of the SSSS^^?^ ^ ° n the basis of < he 

sequence signal. The transforming means m^fa^orilS? ^ fr ° m the firSt Coded movin 9 picture 
of the picture into a b.ock data for each of th btecks The %S^i££T *F ° ri9in3 ' PiCtUfe data < or each 
scaling factor on the basis of the original scaling factor COntro,l,ng means ma V °e operated to update the 

second transmitting path and comprises- inouttino mSn J J? P ?? ed between a first transmitting path and a 
signal through the first transmitting^ t!Z put ™™tetS^LT C ° ded moving P'cturesequence 
consisting of a series of pictures; decoding means fo r dlcoZl ^ t p,cture seguence si 9nal 

inputted through the inputting means to reSmct an SZTll^f m °T 9 P L Cture sec I uence «*nal 

,to an obiective picture data hiving J -be^^ 
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the original picture data; encoding means for encoding the objective picture data oht 3 in P H h« th* 
means to generate a second coded moving picture seauence sinnai- n^fJi obtain f d bv the transforming 
coded moving picture sequence signal generated b ^ the encodS l an P 9 "HT* f ° r ° Utputtin9 the second 
a target bit rate lower than the input bi rate of he ^Sffl^3,S? U9h th6 SeC ° n f transmittin 3 P«h at 
means for controlling the target bit rate ^^^^^S^SXft^S^^ 
temporary scaling factor on the basis of the reconstructed original ^SS^^^^^r^S^ 9 * 
correcting the temporary scaling factor computed by the rate contrSq means on th?ES "IK °* . , 
factor to derive the scaling factor for transforming means. nirOI " ng means on the basis of the or '9'nal scaling 

[0074] In accordance with a fifth aspect of the present invention thprp i<s „ ^ 

comprising a computer usab.e storage medium hai^ computer ^JaSS^mSEfiSSST ^ 
a coded moving picture sequence signal. The computer n^titB^S^^S^^^^^^ 
program code for inputting a first coded moving picture sequence sianal a t an fnnnt h t22 P * ?^ 
picture sequence signal consisting of a series V^rwM^nS^£Xi!^i ' 1 e J ret COded moving 
estimated number of inputting bits to be input by ^wpluSSe or^ !2KS f ^ , C ° mpUting an 
duration on the basis of the input bit rate of the first S^ZJ^^^S^^^^^T^ - 
program code for decoding the first coded moving picture sequence staraffi^iSE 1 * C0 ™ PUte 1 readable 
program code (a) to reconstruct an original picture data for each ^SS^ST^^^T^, 199 ^ 
bits; (d) computer readable program code for computing for each of ?e D fc!X ? real inputting 

bits after the previous picture in the first coded moving picturfseq^nce s anaffs SSH'S ST** of f ,nputting 
readable program code (c) on the basis of the numbe? & reaf inputting bit of t e preS Sfi a°nd 5?' 
estimated number of inputting bits obtained by the computer readable w^^ftW.KZ? * u. 
program code for transforming, on the basis of a scaling' factor the ^S&^^^S^E^ 18 
computer readable program code (c) for each of the pictures into an objec & ^^atetaS^uS^r «f 
real outputting bits less than the number of real inputting bits of the original picture TdaS T?f\ Zji" 
program code for encoding the objective picture data ^r^^^S^^^S^^ 
generate a second coded moving picture sequence signal (g) computerVeadab nroo2m S n ! (e l- to tu 
second coded moving picture sequence signal generated by the comou te7Sdah£^!S2? h^*"?"?' 19 the 
bit rate lower than the input bit rate of the first c?ded moving" X^^^i^K^SSl^ 
program code for computing an estimated number of outputting bits to be output by foe iSSSSS^SSS^ 
program code (g) for the predetermined duration on the basis of the taraet bit rate i tfthV^i7^£? ■ 
picture sequence signal; (i) computer readable program code for Sm P u«ng flSeart «I32iS?5 
number of outputting bits after the previous picture in the second coded Zing pictore SSS^S^T^ 
encoded by the computer readable program code (f) on the basis of the number of real oXtfina So L 
prev.ous picture and the estimated number of outputting bits obtained bv ttaSmrSSSlr , 
(h); (j) computer readable program code for comp^ting.foVlac? ^ pfc^^^^cf ffK^ 

rate of the second coded moving picture sequence signal. 9 0) ° ntr0 ' the target blt 

[0075] In the aforesaid computer program product, the computer readable program code (d) mav have- fd-n 
computer readable program code for initializing the remaining number of inputting bS of the cunem oicture on h» 
basis of the estimated number of inputting bits; (d2) computer readable program code for uodatino KiSJJ 6 
number of inputting bits of the current picture on the basis of the numbeFS real iSiS bff 33?.^i2^ 09 
picture and the remaining number of inputting bits of the prevfous i picture •TdsSZSSSiS^ P S , 
for repeating the computer readable program code (62) fo • each of the ^^aK^Ll^^ 

ZSE&'S^ the computer readable program codes (A W^iS^ff - * 

[0076] The computer readable program code (h) may further comprise: (hi) computer readable oroaram mri* for 
initializing the remaining number of outputting bits of the current picture on he basis if ttfe es fmSi nurSfr ^ 
outputting bits; (h2) computer readable program code for updating the remaining TZ^JSSSXSSL 
current picture on the basis of the number of real outputting bits of the previous picture and the SSln?™J5i 
of outputting bits of the previous picture; (h3) computer readable program code fo reLTnX^Z^ 
readable program code (h2) for each of the pictures; and (h4) computer readable p ogram £22£L thP 
computer readable program codes (hi) and (h3) at time intervals of the predeterrnined Oration P 9 

[0077] Alternatively, the aforesaid computer program product mav further comnrkp r nmn „i« ««,j»m,. 

code for repeating the computer readable progra'm codes (b), ^(h) and « SS^CSS Pr ° 9ram 

[0078] Alternatively, in the aforesaid computer program product, each of the pictures may consist of a plurality of 
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blocks. The computer readable program code (c) may further have computer readable program code for deriving 
an original scaling factor from the first coded moving picture sequence signal. The computer readable program 
code (e) may comprise: (e1) computer readable program code for dividing the original picture data for each of the 
picture into a plurality of block data respectively corresponding to the blocks; (e2) computer readable program 
code for quantizing the block data for each of the blocks with the scaling factor, and (e3) computer readable 
program code for repeating the computer readable program codes (e1) and (e2) for each of the blocks within the 
picture to generate the objective picture data. The computer readable program code (k) has further computer 
readable program code for updating the scaling factor on the basis of the original scaling factor. 

[0079] In accordance with a sixth aspect of the present invention, there is provided a computer program product 
comprising a computer usable storage medium having computer readable code embodied therein for transcoding 
a coded moving picture sequence signal. The computer readable code comprises: (a) computer readable 
program code for inputting a first coded moving picture sequence signal at an input bit rate, the first coded moving 
picture sequence signal consisting of a series of pictures; (b) computer readable program code for decoding the 
first coded moving picture sequence signal inputted by the computer readable program code (a) to reconstruct an 
original picture data, for each of the pictures, having a number of real inputting bits, and derive an original scaling 
factor; (c) computer readable program code for transforming, on the basis of a scaling factor, the original picture 
data reconstructed by the computer readable program code (b) for each of the pictures into an objective picture 
data having a number of real outputting bits less than the number of real inputting bits of the original picture data; 
(d) computer readable program code for encoding the objective picture data obtained by the computer readable 
program code (c) to generate a second coded moving picture sequence signal; (e) computer readable program 
code for outputting the second coded moving picture sequence signal generated by the computer readable 
program code (d) at a target bit rate lower than the input bit rate of the first coded moving picture sequence signal; 
(f) computer readable program code for computing a temporary scaling factor on the basis of the reconstructed 
original picture data to control the target bit rate of the second coded moving picture sequence signal; and (g) 
computer readable program code for correcting the temporary scaling factor computed by the computer readable 
program code (f) on the basis of the original scaling factor to derive the scaling factor for the computer readable 
program code (c). 

BRIEF DESCRIPTION OF THE DRAWINGS 



[0080] The present invention and many of the advantages thereof will be better understood from the following 
detailed description when considered in connection with the accompanying drawings, wherein: 

FIG. 1 is a block diagram of a first preferred embodiment of the apparatus for transcoding the coded moving 
picture sequence according to the present invention; 

FIG. 2 is a flowchart showing the flow of a main routine executed by the central processing unit of the first 
embodiment of the apparatus as shown in FIG. 1 to employ the method of transcoding the coded moving picture 
sequence according to the present invention; 

FIG. 3 is a flowchart showing the flow of an encoding process called by the main routine shown in FIG. 2; 
FIG, 4 is a flowchart showing, as a second preferred embodiment, the flow of another example of a main routine 
executed by the central processing unit of the transcoder as shown in FIG. 1 to employ the method of transcoding 
the coded moving picture sequence according to the present invention; 

FIG. 5 is a block diagram of a third preferred embodiment of the apparatus for transcoding the coded moving 
picture sequence according to the present invention; 

FIG. 6 is a block diagram of a fourth preferred embodiment of the apparatus for transcoding the coded moving 
picture sequence according to the present invention; 

FIG. 7 is a block diagram of a fifth preferred embodiment of the apparatus for transcoding the coded moving 
picture sequence according to the present invention; 

FIG. 8 is a graph showing the simulation results for characteristics of the relationship between the average 
quantization error and the reduced information volume for the intra macroblock in the transcoder shown in FIG. 7; 
FIG. 9 is a graph showing the simulation results for characteristics of the relationship between the average 
quantization error and the reduced information volume for the inter macroblock in the transcoder shown in FIG. 7; 
FIG. 10 is a block diagram of a sixth preferred embodiment of the apparatus for transcoding the coded moving 
picture sequence according to the present invention; 

FIG. 11 is a graph showing the simulation results for characteristics of the relationship between the average 
quantization error and the reduced information volume for the intra macroblock in the transcoder shown in FIG. 
10; 

FIG. 12 is a graph showing the simulation results for characteristics of the relationship between the average 
quantization error and the reduced information volume for the inter macroblock in the transcoder shown in FIG. 

10; 
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F G. 13 is a schematic block diagram showing a first conventional transcoder 

EVBT °' ^ ^ COntr0 ' ""^ '° T °* **• = * MPEG-2 
™ ]f ,'f ! f ema <| c "«* ^gram stowing a second conventional transcoder 

--sa^^ 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

transcoder 100 of this embodiment is interposed Seen a K/25£« tl0 .u 38 a transc °der 100. The 
transmitting path, not shown, and a<tap!3towiv2^^H ?£ST* Sh ° Wn ' and a second 

form of first bit streams b1 inputted from the fiS tansmHtiS Sth «S mov ' n 9 Picture sequence signal in the 
coded moving picture sequence sfgnaMn the fl5! ™ s2 bifstrlm^'hK ? ra j a,n P ut -Bitrate into another 
path at a target bit rate Target.Bitrate lower than the h^M^STS? SSSS? ? th ? second transmitting 
coded moving picture sequence signal consists of a series of SSu rT h JS^ ° *? fifSt b,t streams b1 - Th e 
.nputted from the first transmitting path has, but ta 'B^Jf 1 ™* the firSt bit Streams b1 

shown in FIG. 13. These same constitutional elements are aimnta^SLZS ? conventional transcoder 50 
as^oseo, the conventional transcoder 50, and Se ZESttZS^SSgZSE^ 

connected to the second transmitting path to output SS'ZtTSSS 
computing unit 107. u,lin9 unit 1ut) ' and a quantization parameter 

~?e^ 

by adapting the quantization parameter Q(j) of each of he r^hZStaX* ° u u tpu u tted second bit streams b2 
given by the variable length decoder 51 and ^S^^^S^ *" baSi ? °f the information 
electrically connected to the variable lenqth encode ?57 andS^I2?f i ^u 3 * 6 controller 110is further 
each of the macroblocks MB(j) to the variable lenofh J™Slf5 9 k f ° °^ tpUt the 9 uantiz ati°n parameter Q(j) of 
encoded into the second bit streams b2 9 8n00der 57 Where ' n the W™***™ parameter Q(j) is U ' 

"» variable .ength decoder 51 and the 
51 and a number of real output b ! ts s ™ from the variable length decoder 

Sin is indicative of the num^llJSSi^ the variable E2E SEE ^ T b6f ° f real inbuttin 9 bits 
outputting bits Sout encoded by the variable ^WSSISt^iJSSS ' number of real 
number of rea, outputting bits lut is less than tne nSr of ^SlJ^tSS J* 6 tranSC ° der fte 

-d^ remaining number of inputting bits Rin 

basis of an estimated number of inputting bits of 2 ffi^KSmTS t° f h nf)Utt,n9 b,ts Rin is com P^d on the 
for a predetermined reference duration Ta and a number o %SZS££i? -nput through the input terminal al 
decoder 51, while the remaining numbe of ^SSJSS^^S^J^ Sin decoded by the variable length 
of outputting bits of the second bit streams b2 to be itout7hrllT P f ?T the bas,S of an estir " a ted number 
reference duration Ta and a number of - out'S 

[0088] The above estimated number of inputting bits of the first bit streams b1 means the initial value for the 
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remaining number of inputting bits Rin of the initial picture in the first bit streams b1 within a time interval of the 
reference duration Ta, while the estimated number of outputting bits of the second bit streams b2 means the initial 
vaJue for the remaining number of outputting bits Rout of the initial picture in the second bit streams b2 within the 
time interval of the reference duration Ta. The detailed description of these initial values will be made later. 

[0089] More specifically, the remaining bit computing unit 101 is designed to update, for each of pictures pic(n), 
the remaining number of inputting bits Rin(n) of the current picture pic(n), and the remaining number of outputting 
bits Rout(n) of the current picture pic(n). The remaining number of inputting bits Rin(n-1) of the previous picture 
pic(n-1) is updated on the basis of the number of real inputting bits Sin(n-1) of the previous picture pic(n-1) before 
the current picture pic(n) is encoded by the variable length encoder 57, while the remaining number of outputting 
bits Rout(n-1) of the previous picture pic(n-1) is updated on the basis of the number of real outputting bits Sout(n- 
1 ) of the previous picture pic(n-1 ) before the current picture pic(n) is encoded by the variable length encoder 57 
as follows: 

"equation (32) M Rin(n)=Rin(n-1)-Sin(n-1) 
"equation (33)" Rout(n)=Rout(n-1)-Sout(n-1) 



[0090] The initial value for the remaining number of inputting bits Rin(1) of the first picture pic(1) within the first bit 
streams b1 and the initial value for the remaining number of outputting bits Rout(1) of the first picture pic(1) within 
the second bit streams b2 are given by the following equations (34) and (35), respectively: 

"equation (34)" Rin(1) = lnput_Bitrate x UTW DIVIDED picture_rate 

"equation (35)" Rout(1) = Target_Bitrate x UTW DIVIDED picture_jate 

where lnput_Bitrate is the input bit rate of the first bit streams b1 and obtained from the first bit streams b1 by the 
variable length decoder 51, picture_rate is a picture rate of the inputted first bit streams b1 expressed in the 
number of frames per second and also obtained from the first bit streams b1 by the variable length decoder 51, 
Target_Bitrate is the target bit rate of the second bit streams b2 and inputted through an input terminal a3, and 
UTW is the number of pictures processed for the reference duration Ta and inputted through an input terminal a4. 
Here, (UTW/picture_rate) is equal to the above reference duration Ta. 

[0091] For example, when it is assumed that picture_rate may be equal to thirty frames per second and UTW may 
be equal to fifteen, the reference duration Ta becomes 0.5 seconds. In another case when it is assumed that 
picture_rate may be equal to thirty frames per second and UTW may be equal to thirty, the reference duration Ta 
becomes one second. In this embodiment, UTW and TargetJ3itrate are constant throughout an entire transcoding 
process, but if necessary, appropriately variable. In another embodiment, UTW and Target_Bitrate may be 
previously set by internal switches and may be variable in accordance with a predetermined command 
transmitted from an externa! device. 

[0092] Furthermore, the remaining bit computing unit 101 is designed to initialize the remaining number of bits Rin 
(n) and Rout(n), before the initial picture within a time interval of the reference duration Ta is processed as 
follows: 

"equation (36)" Rin(n) = Rin(n-1) + lnput_Bitrate x UTW DIVIDED picture_rate 
"equation (37) M Rout(n) = Rout(n-1) + TargeLBitrate x UTW DIVIDED picture^rate 



[0093] The target ratio computing unit 103 is electrically connected to the remaining bit computing unit 101 and 
designed to input the remaining numbers of bits Rin(n) and Rout(n) of the current picture pic(n) from the 
remaining bit computing unit 101 to compute a target ratio ioRatio(n) for each of pictures pic(n). The target ratio 
ioRatio(n) is indicative of a ratio of the remaining number of outputting bits Rout(n) to the remaining number of 
inputting bits Rin(n) for each of the pictures pic(n) as follows: 
"equation (38)" ioRatio(n) = Rout(n) DIVIDED Rin(n) 



[0094] The virtual buffer fullness controlling unit 105 is electrically connected to the target ratio computing unit 103 
and designed to input the target ratio ioRatio(n) for each of pictures pic(n) from the target ratio computing unit 
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103. The virtual buffer fullness controlling unit 105 is also electrically connected to the variable length decoder 51 
and the variable length encoder 57. The virtual buffer fullness controlling unit 105 is designed to input the number 
of decoding bits rinft-1) of the (j-1)th macroblock MB(j-1) within the corresponding picture generated by the 
variable length decoder 51 before the j-th macroblock MB(j) is encoded, and also input the number of encoding 
bits routG-1) of the (j-1)th macroblock MB(j-1) within the corresponding picture encoded by the variable length 
encoder 57 before the j-th macroblock MB(j) is encoded. 

[0095] The virtual buffer fullness controlling unit 105 is further designed to calculate a virtual buffer fullness, 
referred to as VB "equation (39)" VB where the initial value of the virtual buffer fullness VB 
"equation (40)" VB 
"equation (41)" VB 
"equation (42)" VB 



[0096] Here, Kp and Kb axe universal constants dependent on the quantization matrices. When Kp=1.0 and 
Kb=1.4, the quality of the image can be always optimized. 

[0097] The quantization parameter computing unit 107 is electrically connected to the virtual buffer fullness 
controlling unit 105 and designed to input the virtual buffer fullness VB "equation (43)" Q(j) = VB where r is a 
reaction parameter defined by the following equation (44). 
"equation (44)" r = 2xTarget__Bitrate DIVIDED picturej-ate 



[0098] In another embodiment, the virtual buffer fullness may be common to any type of pictures. In this case, the 
initial value of the virtual buffer fullness may be given by the above equation (40). 

[0099] The transcoder 100 further comprises a central processing unit 109, hereinlater referred to as simply 
"CPU", for controlling the whole process in the transcoder 100. The process of the transcoder 100 controlled by 
the CPU 109 will be described with reference to FIGS. 2 and 3 of the drawings. The CPU 109 is operable to 
execute a predetermined program recorded in a computer usable storage medium, such as a ROM, having 
computer readable code embodied therein for transcoding a coded moving picture sequence according to the 
present invention. 

[0100] Referring now to FIG. 2 of the drawings, there is shown a flowchart of a main routine in the process 
controlled by the CPU 109 to employ the method of transcoding a coded moving picture sequence according to 
the present invention. As shown in FIG. 2, the main routine comprises the steps D1 to D1 1 . 

[0101] In the step D1 , "1" is assigned to the picture number variable n representing a serial number of pictures 
within the first bit streams b1 . In the step D2, a timer for measuring the reference duration Ta is started, while the 
remaining bit computing unit 101 is operated to initialize the remaining number of inputting bits Rin(1) and the 
remaining number of outputting bits Rout(1) of the first picture pic(1) in accordance with the above equations (34) 
and (35), respectively. In this embodiment, the reference duration Ta is 1 or 0.5 seconds. As described above, the 
reference duration Ta is derived on the basis of UTW inputted through the input terminal a4 and the picture_rate 
inputted from the variable length decoder 51 . 

[0102] In the following step D3, the judgment is made whether the reference duration Ta elapses or not. When the 
answer is "NO", i.e., the reference duration Ta has not been passed yet, the step D3 goes to the step D4. When 
the answer is "YES", the step D3 goes to the step D5 wherein the timer is reset and the step D5 further goes to 
the step D7. In another embodiment, the step D3 may be replaced with another monitoring procedure for 
monitoring a time-out of the above timer whereby the main routine may be interrupted with the time-out of the 
above timer in order to go to the step D5. 

[0103] In the step D4, the judgment is made whether the picture number variable n is 1 or not, i.e., the current 
picture pic(n) is the first picture pic(l) or not. When the judgment is made that the current picture pic(n) is not the 
first picture pic(1), the step D4 goes to the step D6. When the judgment is made that the current picture pic(n) is 
the first picture pic(1), the step D4 bypasses the step D6 to go to the step D8. 

[0104] In the step D6, the remaining bit computing unit 101 is operated to update the remaining number of 
inputting bits Rin(n) and the remaining number of outputting bits Rout(n) of the n-th picture pic(n) in accordance 
with the above equations (32) and (33), respectively. On the other hand, in the step D7, the remaining bit 
computing unit 101 is operated to initialize the remaining number of inputting bits Rin(n) and the remaining 
number of outputting bits Rout(n) of the n-th picture pic(n) in accordance with the above equations (36) and (37), 
respectively. 



http://12.espacenet.com/espacenet/desc?LG=en&CY=ep&DB=EPD&PNP=EP1067798&PN=EPl... 9/4/2003 



esp@cenet - Document Description 



Page 16 of 26 



[0105] The step D6 or D7 goes to the step D8 wherein the target ratio computing unit 103 is operated to commit* 

Sfnnf h rat '° ' 0R , at,0(n) ° f thS n " th Picture pic(n) in ^^ance with the ^eqi^SS^SSSS^ 
step D9 he encoding process is called. This encoding process will be described later When the controls 
returned from the encoding process to the step D9, the step D9 goes to the step D1? SI the picture number 
variable n is incremented by 1 . In the following step D1 1 , the judgment is made whethe the picture number 
yanab e n ,s more than a predetermined total number of a series of pictures NPIC ^^vSl^SSL is 
NO the control ,s returned from the step D1 1 to the step D3. When the answer is "YES" the main routine is 
terminated. The picture number variable n thus serves as a loop counter for repealing the stem MM to D O to 
process all the pictures pic(n) in the current GROUP OF PICTURE. The entire pictu ires thl first Scture oicm lln 
to the NPIC-th picture pic(NPIC), in the current GROUP OF PICTURE can be > thus pSesLd inC ^ " P 

[0106] Next, the encoding process called by the step D9 in the main routine shown in FIG 2 will be described 
hereinlater with reference to FIG. 3 of the drawings. The encoding process comprises the steps E? toEB 

[0107] In the step E1 , "1" is assigned to a macroblock number variable j representing a serial number of 
macroblocks within one of the pictures. In the following step E2, the virtual buffer fullness controE Tun 1 105 is 
operated to compute the virtual buffer fullness VB(j) of the j-th macroblock MB(j) in accordance with the above 
iStonlrS Ht the approp ? e picture *P* ln the followi ng step E3, the quantization paramete computing unit 

Z K^J?J32?S) ce quant,zation parameter Q(j) for the j " th macro " lock MB0) in 

[0108] In the step E4 the quantizer 55 is operated to quantize the j-th macroblock MB(j) with the reference 
quantization parameter Q(j) given in the above step E3. In the following step E5, the macroblock number variable 
j is incremen by 1. In the following step E6, the judgment is made whether the macroblock numbe'varfabll is 
more than a total number of macroblocks NMB within the n-th picture pic(n). When the answer is "NO the control 
is returned from the step E6 to the step E2. When the answer is "YES", the encoding process is terminated and 
the contro ls returned to the main routine. The macroblock number variable j thus serves as a loop counter for 
repeating the steps E2 to E5 to encode all the macroblocks MB(j) in the present picture pic(n) The entire 
toufe^d Intern maCr ° bl ° Ck MB(1 > Up t0 the NMB " th m ^roblock MB(NMB), in the n-th picture pic(n) can be 

[0109] In this embodiment, the target ratio ioRatio is updated whenever each of the picture is encoded In another 
embodiment the target ratio ioRatio may be constantly determined on the basis of the input bft rate toput Borate 
and the targe bit rate Target_Bitrate. In this case, the target ratio computing unit 103 is directly electocafc 

Ta^e? Borate ^ * ihe inpUt bit rate ln P ut - Bitrate as we " ™ the target bft rate 

[0110] The operation of the transcoder 1 00 of the first embodiment will be described hereinlater in detail. 

[01 11] As shown in FIG 2, "1" is assigned to the picture number variable n in the step D1 of the main routine In 
the following step D2, the timer is set to the reference duration Ta and started to measure the reference duration 
Ta. Moreover, the remaining number of inputting bits Rin(1) and the remaining number of outputtinq bits Routd) 
nnVJni f rtl ln C n, anC6 . W L h th f t quationS < 34 ) and respectively, by the remaining bit computing 
« ♦ ?° eS 2 the f tep 03 Wherein the J"^gnnent is then made whether the reference duration Ta 
e apses or not. At this time, the reference duration Ta has not been passed yet, so that the step D3 goes to the 
step D4. In the step D4, the judgment is made whether the picture number variable n is 1 or not i e the current 
picture is the first picture pic(1) or not. At this time, the current picture is the first picture pic(1). Consequently the 
step D4 goes to the step D8 wherein the target ratio ioRatio(1 ) of the first picture pic(1) is computed by the target 
ratio computing unit 103 ,n accordance with the above equation (38). The encoding process shown in FIG 3 s 
then caHed in the next step D9. In the encoding process, all of the macroblocks within the first picture pic(l) are 
encoded After the control is returned from the encoding process to the step D10, the picture number variable n is 
incremented by - -r into "2". In the following step D11, the judgment is made wheiher the piiw nuSS^S^ 
n is more than the total number of pictures NPIC or not. At this time, the picture number variable n is two i e less 
than the total number of picture NPIC. Consequently, the control is returned from the step D1 1 to the step D3. 

[0112] In the step D3, the judgment is then made whether the reference duration Ta elapses or not At this time 
the reference duration Ta has not been passed yet, so that the step D3 goes to the step D4 wherein the judgment 
is made whether the picture number variable n is 1 or not. At this time, the picture number variable n is 2 so that 
the s tep D4 goes to the step D6 wherein the remaining number of inputting bits Rin(2) and the remaininq' number 
of outputting bits Rout(2) are updated in accordance with the above equations (32) and (33) by the remaining bT 
computing unit 101. In the following step D8, the target ratio ioRatio(2) for the second picture pic(2) is computed 
by the target ratio computing unit 103 in accordance with the above equation (38). The encoding process shown 
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in FIG. 3 is then called in the next step D9. In the encoding process, all of the macroblocks within the second 
picture pic(2) are encoded. After the control is returned from the encoding process to the step D10, the picture 
number variable n is incremented by "1" into "3". In the following step D11, the judgment is made whether the 
picture number variable n is more than the total number of pictures NPIC or not. At this time, the picture number 
variable n is three, i.e., less than the total number of picture NPIC. Consequently, the control is returned from the 
step D11 to the step D3. 

[01 13] Until the reference duration Ta elapses, the above process is repeated for each of the pictures in turn. 
When the reference duration Ta, for example, 1 second, elapses, the thirtieth picture pic(30) has been encoded. 
Before the 31 picture pic(31) is encoded in the step D9, the judgment is made in the step D3 that the reference 
duration Ta elapses. Then the step D3 goes to the step D5 wherein the timer is reset to newly start counting the 
reference duration Ta. In the following step D7, the remaining number of inputting bits Rin(31) and the remaining 
number of outputting bits Rout(31) are initialized in accordance with the above equations (36) and (37) by the 
remaining bit computing unit 101. The step D7 then goes to the step D8 thereafter the aforesaid process will be 
repeated. 

[01 14] Then, the CPU 109 of the transcoder 100 is operated to repeat the steps D3 to D1 1 until the picture 
number variable n exceeds to the total number of picture NPIC. The judgment is made in the step D1 1 that the 
picture number variable n exceeds to the total number of picture NPIC, the main routine shown in FIG. 2 is 
terminated. Thus, all the pictures within one of the GROUP OF PICTURES are encoded. 

[01 15] The first embodiment of the transcoder 100 thus constructed can achieve the efficient rate control wherein 
there is no need of information excluded from the coded moving picture sequence signal and no limitation in the 
form of the coded moving picture sequence signal prepared by the encoder in order to real timely and effectively 
reduce the bit rate of the coded moving picture sequence with low delay. 

[0116] Referring now to FIG. 4 of the drawings, there is shown the flowchart of another main routine in the 
process controlled by the CPU 109 as a second preferred embodiment of the method of transcoding a coded 
moving picture sequence according to the present invention. As shown in FIG. 4, the main routine comprises the 
steps F1 to F6 in the second embodiment. 

[01 17] In the step F1, "1" is assigned to a picture number variable n indicative of a serial number of the pictures 
pic(n) within the inputted first bit streams bl In the step F2, the remaining bit computing unit 101 is operated to 
update the remaining number of inputting bits Rin(n) and the remaining number of outputting bits Rout(n) of the n- 
th picture pic(n) within the reference duration Ta in accordance with the above equations (32) and (33), 
respectively. Here, when the picture number variable n equals to 1 , the remaining number of inputting bits Rin(1) 
and the remaining number of outputting bits Rout(1 ) of the first picture pic(1 ) is only initialized in accordance with 
the above equations (34) and (35). 

[01 18] In this embodiment, the remaining number of inputting bits Rin(n) and the remaining. number of outputting 
bits Rout(n) of the n-th picture pic(n) correspond to the remaining number of bits of the pictures in the whole range 
of the number of pictures UTW. 

[01 19] In another embodiment, the number of real inputting bits Sin(n) of the current picture pic(n) and the number 
of real outputting bits Sout(n) of the current picture pic(n) may be updated by summing up a first predetermined 
number of pictures encoded prior to the n-th picture pic(n), i.e., previously encoded a predetermined time ago, to 
obtain a total number of real inputting bits Sin(n) of the current picture pic(n) and a total number of real outputting 
bits Sout(n) of the current picture pic(n) for each of pictures. 

[0120] In further another embodiment, the remaining number of inputting bits Rin(n) of the current picture pic(n) 
and the remaining number of outputting bits Rout(n) of the current picture pic(n) may be updated by summing up 
a second predetermined number of pictures encoded prior to the n-th picture pic(n), i.e., previously encoded 
another predetermined time ago. 

[0121] In the following step F3, the target ratio computing unit 103 is operated to compute the target ratio ioRatio 
(n) of the current picture pic(n) in accordance with the above equation (38). In the following step F4, the aforesaid 
encoding process shown in FIG. 3 is called. When the control is returned from the encoding process to the step 
F4, the step F4 goes to the step F5 wherein the picture number variable n is incremented by 1. In the following 
step F6, the judgment is made whether the picture number variable n is more than a predetermined total number 
of a series of pictures NPIC in or not. When the answer is "NO", the control is returned from the step F6 to the 
step F2. When the answer, is "YES", the main routine is terminated. The steps F2 to F5 in the main routine can be 
thus repeated for the whole pictures to be transformed by the transcoder 1 00. 
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[0122] The operation of the transcoder 100 of the second embodiment will be described hereinlater in detail. 



[0123] As shown in FIG. 4, "1" is assigned to the picture number variable n in the step F1 of the main routine. In 
the following step F2, the remaining number of inputting bits Rin(1) and the remaining number of outputting bits 
Rout(1) of the first picture pic(1) are initialized in accordance with the above equations (34) and (35), respectively, 
by the remaining bit computing unit 101. The step F2 goes to the step F3 wherein the target ratio ioRatio(1) of the 
first picture pic(1) is computed in accordance with the above equation (38) by the target ratio computing unit 103. 
The step F3 goes to the step F4 wherein the encoding process shown in FIG. 3 is called. In the encoding process, 
all of the macroblocks within the first picture pic(1) are encoded. After the control is returned from the encoding 
process to the step F5, the picture number variable n is incremented by "1" into "2". In the following step F6, the 
judgment is made whether the picture number variable n is more than the total number of pictures NPIC or not. At 
this time, the picture number variable n is two, i.e., less than the total number of picture NPIC. Consequently, the 
control is returned from the step F6 to the step F2. 

[0124] In the step F2, the remaining number of inputting bits Rin(2) and the remaining number of outputting bits 
Rout(2) of the second picture pic(2) are computed in accordance with the above equations (32) and (33), 
respectively, by the remaining bit computing unit 101 . The step F2 goes to the step F3 wherein the target ratio 
ioRatio(2) of the second picture pic(2) is computed in accordance with the above equation (38) by the target ratio 
computing unit 103. The step F3 goes to the step F4 wherein the encoding process shown in FIG. 3 is called. In 
the encoding process, all of the macroblocks within the second picture pic(2) are encoded. After the control is 
returned from the encoding process to the step F5, the picture number variable n is incremented by "1" into "3". In 
the following step F6, the judgment is made whether the picture number variable n is more than the total number 
of pictures NPIC or not. At this time, the picture number variable n is three, i.e., less than the total number of 
picture NPIC. Consequently, the control is returned from the step F6 to the step F2. 

[0125] Then, the CPU 109 of the transcoder 100 is operated to repeat the steps F2 to F5 until the picture number 
variable n exceeds to the total number of picture NPIC. The judgment is made in the step F6 that the picture 
number variable n exceeds to the total number of picture NPIC, the main routine shown in FIG. 4 is terminated. 
Thus, the pictures within one of the GROUP OF PICTURES are encoded. 

[0126] The above transcoder 100 thus constructed in the second embodiment can also achieve the efficient rate 
control wherein there is no need of information excluded from the coded moving picture sequence signal and no 
limitation in the form of the coded moving picture sequence signal prepared by the encoder in order to real timely 
and effectively reduce the bit rate of the coded moving picture sequence with low delay. 

[0127] As described above, the apparatus, method and computer program product for transcoding the coded 
moving picture sequence according to the present invention can be operated to compute the target ratio ioRatio 
on the basis of the remaining number of bits Rin and Rout for a predetermined reference duration and to control 
the virtual buffer of each of macroblocks on the basis of the target ratio ioRatio. This operation is equivalent to 
that of the aforesaid rate control of TM-5 in both of steps I and II. Furthermore, there is no need to estimate the 
structure of pictures. Even if there is a great variation in the number of inputting bits of the coded moving picture 
sequence signal due to the change of scene, the appropriate rate control can be achieved. 



Experimental simulation result 

[0128] The delay in transcoding was measured in the transcoder 100 of the first embodiment under the following 
condition: 

Input MPEG-2 bit streams: ITU-R Rec. 601 signal having 4:2:0 format; and 
Sequence Bus: a size of 704pixelsx480lines, and a bit rate of 15Mbps. 



[0129] The process shown in FIG. 2 was performed by the transcoder 100 of the first embodiment. The 
experimental simulation was conducted to determine the delay of the time measured from the input of the bit 
streams to the start of transcoding. As the experimental simulation result, the average of the delay measured 
0.0253msec in the transcoder 100 according to the present invention. This means that the transcoder 100 
according to the present invention can remarkably reduce the delay in transcoding by 99.924% with respect to the 
delay of 33.36msec in the conventional transcoder. 

[0130] Referring now to FIG. 5 of the drawings, there is shown a third preferred embodiment of the apparatus for 
transcoding the coded moving picture sequence according to the present invention as a transcoder 200. The third 
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embodiment of the transcoder 200 comprises a rate controller 210 instead of the rate controller 1 1 0 of the first 
2??IT ? f . he transc + od ,f r 1 00 shown in FIG - 1 The rate controller 21 0 of the tmn^SlMo^Si 
virtual buffer fu ness controlling unit 205 and the same constitutional elements as those ^tS^SSSSZ^ of 
the transcoder 100 shown in FIG. 1 except for the virtual buffer fullness controlling unit 105 These same 
constitutional elements are simply represented by the same reference numerals as those of the first embodiment 
of the transcoder 100 shown in FIG. 1, and will be thus omitted from description for avoiding t^ious^pefitoT 

l°n\ 31] L h 5 V,rtUal J b f er fu Au eS f controllin 9 unit 205 is electrically connected to the target ratio computing unit 
103, and designed to input the target ration ioRatio(n) from the target ratio computing Snit 103 The virtuil buffer 
fullness controlling unit 205 is also electrically connected to the variable length decoder 51 and the variable > lemrth 

of the 0-1 )th macroblock MBO-1 within the corresponding picture generated by the variable length decoder 51 
before the j-th macroblock MBQ) is encoded, and also input the number of encoding bits rout(M ) of the (\ itth 
macroblock MB(j-1) within the corresponding picture encoded by the variable length encoder 57 before the i h 
macroblock MB(j) is encoded. e J in 

[0132] The virtual buffer fullness controlling unit 205 is further designed to calculate a virtual buffer fullness 
referred to as VB "equation (45)" VB where rd (rd>0) is a delay controlling parameter for controlling the delav 
factor in the transcoding process, thereby making it possible to adjust the level in the feedback process For 
example, the delay quantity in the transcoding can be reduced, as the delay controlling parameter rd becomes 
larger. As a result, the speed of the transcoding process can be increased. " 

[0133] The delay quantity in the transcoding is monotonically reduced as the delay controlling parameter rd 
becomes larger. For instance, the delay quantity in the transcoding may be reduced bv 90% from 20msec to 
2msec within a range of the delay controlling parameter rd: 1.0= 

[0134] The larger delay controlling parameter rd however causes the S/N (Signal to Noise) ratio indicative of the 
quality of the image to deteriorate. According to the experiment, the maximum of the S/N ratio was caused bv the 
delay controlling parameter rd within the range: 0 y 
[01 35] The virtual buffer fullness VB 

[0136] The third embodiment of the apparatus and method for transcoding the coded moving picture sequence 
according to the present invention has an advantage over the prior art in achieving the control of the delay in 
transcoding as well as the same function and effect as those of the first and second embodiments. 

[0137] Referring now to FIG. 6 of the drawing, there is shown a fourth preferred embodiment of the apparatus for 
transcoding the coded moving picture sequence according to the present invention as a transcoder 300. The 
fourth embodiment of the transcoder 300 comprises a rate controller 310 instead of the rate controller 110 of the 
first embodiment of the transcoder 100 shown in FIG. 1. The rate controller 310 of the transcoder 300 comprises a 
target ratio computing unit 303 and the same constitutional elements as those of the first embodiment of the 
transcoder 100 shown in FIG. 1 except for the target ratio computing unit 103. These same constitutional 
elements are simply represented by the same reference numerals as those of the first embodiment of the 
transcoder 100 shown in FIG. 1, and will be thus omitted from description for avoiding tedious repetition. 

[0138] The target ratio computing unit 303 is electrically connected to the remaining bit computing unit 101 and 
designed to input the remaining numbers of inputting and outputting bits Rin(n) and Rout(n) of the current picture 
pic(n) from the remaining bit computing unit 101 to calculate a target ratio ioRatio(n) indicative of a ratio of the 
remaining number of outputting bits Rout(n) to the remaining number of inputting bits Rin(n) for each of the 
pictures pic(n) as follows: 

"equation (46)" ioRatio(n) = Rout(n) DIVIDED Rin(n) x wi,p,b 

where wi,p,b are weighting parameters for determining the weight for I, P and B-pictures, respectively, thereby 
making it possible to control the number of coding bits for each type of pictures. When the pictures have no need 
to be weighted, 1.0 may be assigned to the corresponding weighting parameters wi,p,b. In order to weight the 
pictures, the corresponding weighting parameter wi,p,b may become smaller than 1.0. 

[01 39] For example, the larger ratio of the output bit rate to the input bit rate is liable to cause the quality of the 
image to deteriorate. In order to prevent the deterioration in the quality of the image, the weighting parameters 
wi,p,b may be varied to determine the weight of the corresponding pictures. 

[0140] In another embodiment, in other to fix the total number of encoding bits within the GROUP OF PICTURES 
at the same level throughout the transcoding process for the target moving picture sequence, the relationship 
between the weighting parameters wi,p,b and the number of corresponding pictures within GROUP OF 
PICTURES may be restricted under the following condition: 
"equation (47)" RiNi+RpNp+RbNb=RiwiNi+RpwpNp+RbwbNb 

where Ni, Np and Nb are the number of pictures of I, P and B-pictures, respectively, within the GROUP OF 
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PICTURES. Ni, Np or Nb is given as follows: 8 
"equation (48)" Ni=1 
"equation (49)" Np=N/M-1 
"equation (50)" Nb=N-N/M 

P or B-pictures within each of the GROUP OF PICTURES PICTURE, while M is a picture rate of 

[0142] When the numbers of coding bits for both of I and P-Dicture* ar* inrmoc^ * ^ 

[0143] For example, the weighting parameters wi and wp were set at less than 1 n i» 
encoding bits of the I and P-pictures were increased white fhJ JSmhif 1* J- - S Case> the number of 
reduced. On the other hand.the S/N TatS £ be » S^S^ w 

smaller and the weighting parameter wb became E?f3£J!^ ffi2^ m ¥ re Wi and wp became 
invention can improve to remarkably reduce ftVd^n fS^^? "* method according to the present 
comparison with the conventional method * transcod,n 9 from 100-500msec to less than 50msec in 

buffiness^^ ^ then outputted to the virtual 

same process as the firs', or second e^Sn how n HG 2 tT2S3S le!^m^^^ ^ 
target ratio ioRatio is computed in accordance with the above eqL^ 

Kdi^t^ 

transcoding as well as the same function and effect as thoseo? Z f^^ZTse^TeT^T 

[0146] In the fourth embodiment, the transcoder 300 may comprise the virtual buffer fullness controlling ..nit 9 nc 
same as that of the third embodiment shown in FIG. 5 instead of the virtualbuffe ^S^^S^Jt ^ 05 

[0147] It will be appreciated from the above description that the annar-atii* moth^n ^ ~ * 
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[0151] The quantization parameter calculator 412 is electrically connected to the variable length decoder 51 and 
designed to input the first quantization parameter Q1(j) for each of macroblocks MB(j) from the variable length 
decoder 51 . The quantization parameter calculator 412 is further electrically connected to the rate controller 410 
and designed to input the re-quantization parameter Q(j) for each of macroblocks MB(j) from the rate controller 
410. The quantization parameter calculator 412 is further designed to calculate the second quantization 
parameter Q2(j) for each of macroblocks MB(j) by correcting the re-quantization parameter Q(j) on the basis of the 
first quantization parameter Q1(j) for each of macroblocks MB(j). The detailed description of this calculation will be 
made later. The calculated second quantization parameter Q2(j) for each of macroblocks MB(j) is then transmitted 
from the quantization parameter calculator 412 to the rate controller 410, the quantizer 55 and the variable length 
encoder 57. 

[0152] The rate controller 410 is operable to perform the feedback control on the basis of the second quantization 
parameter Q2(j). The quantizer 55 is operable to perform the rate control on the basis of the transmitted second 
quantization parameter Q2(j). Furthermore, the variable length encoder 57 is operable to generate the objective 
picture data including the transmitted second quantization parameter Q2(j) to output the second bit streams b2. 

[0153] The calculation in the quantization parameter calculator 412 is performed on the basis of the following 
theory and experimental simulation results. 

[0154] Referring to FIGS. 8 and 9 of the drawings, there are shown graphs of the experimental simulation results 
for characteristics of the relationship between an average quantization error "D" and a reduced information 
volume "Rred" FIG. 8 shows a graph for the intra macroblock, while FIG. 9 shows a graph for the inter 
macroblock. The characteristics of the relationship between the average quantization error D and the reduced 
information volume Rred are representative of the rate-distortion performance in converting the first quantization 
level (Qlxlevel) into the second quantization level (Q2xtlevel). 

[0155] The average quantization error D is derived as follows: 
"equation (52)" D = - INFINITY INFINITY {d(Ievel)} P(levei) 

where d(level) is a difference between the first quantization level (Qlxlevel) and the second quantization level 
(Q2xtlevel), while P(level) is a quantization level probability of generating the quantization coefficients level. 

[0156] The difference d(level) is given depending on the types of macroblocks as follows: 



where the above equation (53) is used for the inter macroblock, while the equation (54) is used for the intra 
macroblock. The inputted DCT coefficients may be assumed to be a Laplacian distribution. In this case, the 
typical density function of the probability may be applicable to the DCT coefficients p(x) as follows: 
"equation (55)" p(x) = 1 DIVIDED 2 sigma exp-2|xj DIVIDED sigma 

[0157] The quantization level probability P(level) is then given on the basis of the above equation (55) as: 
"equation (56)" P(level) = (level-1 DIVIDED 2)Q1(level+1 DIVIDED 2)Q1 p(x)dx = (level-1 DIVIDED 2)Q1(level+1 
DIVIDED 2)Q1 1 DIVIDED 

[0158] The above equation (52) is evaluated by replacing d(level) with the above equation (53) or (54), and 
replacing P(level) with the equation (56), and simplified to lead to a function of only Q1, Q2, and level. 

[0159] On the other hand, the reduced information volume Rred is derived as follows: 
"equation (57)" Rred=Rorg-Ravg 

where Rorg is an original average information volume indicative of the avenge information volume of the original 
quantization coefficients level before reducing the number of bits, while Ravg is an average information volume 
indicative of the average of information volume of the re-quantization coefficients tlevel after reducing the number 
of bits. 

[0160] The original average information volume Rorg is derived by: 
"equation (58)" Rorg = - INFINITY INFINITY P(level) x l(level) 

where l(level) is a self-information volume of the quantization coefficients level and given on the basis of the 
probability P(level) as follows: 
"equation (59)" l(level)-log2P(level) 
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[0161] The original average information volume Rorg is then derived by: 
"equation (60)" Rorg = - INFINITY INFINITY P(level)log2 P(level) 



[0162] The self-information volume l(tlevel) of the re-quantization coefficients tlevel is similarly given by the 
probability P(tlevel) as follows: 
"equation (61)" !(tlevel)-log2P(tlevel) 



[0163] The average information volume Ravg is similarly derived by: 
"equation (62)" R = ~ INFINITY INFINITY P(tlevel)log2 P(tlevel) 



[0164] The experimental simulations shown in FIGS. 8 and 9 were conducted under the following condition: 

sigma =4.0; and Q2 was varied between integers 1 and 31 in each case where 1,2, 4, 6, or 8 was substituted for 
Ql 



[0165] It will be apparent from the graphs shown in FIGS. 8 and 9 that the average quantization error D can be 
reduced in both of the inter and intra macroblocks as the first quantization parameter Q1 becomes smaller. This 
means that the minute de-quantization performed by the de-quantizer 53 can causes the average quantization 
error D to decrease, thereby efficiently reducing the information volume. 

[0166] In the intra macroblock, the characteristic in the rate-distortion performance in converting the quantization 
levels is represented by five stepped waveforms for each of Q1=1 , 2, 4, 6, and 8 denoted by symbols (+), (X), (*), 
( &squ& ), and ( &squf& ), respectively, as shown in FIG. 8. Particularly, as the first quantization parameter Q1 
becomes larger, the stepped waveforms in the rate-distortion performance characteristic tend to become coarse 
and sharp. This leads to the fact that not only the efficiency is declined, but also the reduced information volume 
is liable to restrict itself. For example, there were only two values of the reduced information volume Rred as 
shown in the leftmost stepped waveform ( &squf& ), i.e., wherein the first quantization parameter Q1 is equal to 8. 



[0167] Furthermore, even though the reduced information volume Rred is constant with respect to the first 
quantization parameters Q1 on a vertical line area, one of which is represented by the reference numeral "W1" in 
FIG. 8, within the stepped waveform, the average quantization error D will be variable in accordance with the 
value of the second quantization parameter Q2. As a result, the average quantization error D is apt to increase 
but the information volume nevertheless prevents from reducing, when the selection of the second quantization 
parameter Q2 is made with taking no account of the characteristic in the rate-distortion performance in converting 
the quantization levels. 

[0168] In the meantime, the inter macroblock has the different characteristic in the rate-distortion performance in 
converting the quantization levels from that of the intra macroblock as shown in FIG. 9. The characteristic in the 
rate-distortion performance in converting the quantization levels is represented by five relatively smooth curved 
lines, for each of Q1=1, 2, 4, 6, and 8, progressively increasing with respect to the second quantization parameter 
Q2 as shown in FIG. 8. Particularly, the plots are liable to concentrate at a specific point having the larger second 
quantization parameter Q2. Namely, the difference in the relationship between the reduced information volum 
and the average quantization error D becomes smaller with respect to the second quantization parameter Q2, as 
the de-quantizer 53 is operated to perform the rougher de-quantization. This results in the fact that the 
characteristic in the rate-distortion performance in converting the quantization levels is constant over most of the 
second quantization parameters Q2. 

[0169] The characteristic in the rate-distortion performance in converting the quantization levels has some turning 
points, for example, "TQ7 n and "TQ15", derived by the following equation (63) or (64): 

where m is natural numbers. The equation (63) is used for the inter macroblock, while the equation (64) is used 
for the intra macroblock. 

[0170] As shown in FIG. 8, there are some vertical line areas in the stepped waveforms wherein the reduced 
information volume Rred is constant. The first quantization parameter Q1 is equal to 4, and the reduced 
information volume Rred is nearly equal to 1 .32 within the vertical line area W1 . The average quantization error D 
can have individual values respectively corresponding to the individual second quantization parameters Q2 the 
within the vertical line area W1. One of the second quantization parameter Q2 corresponding to the minimum 
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average quantization error Dmin may be preferably selected from among a plurality of values within the vertical 
line area W1 . 

[0171] In order to select the above appropriate value of the second quantization parameter Q2, the second 
quantization parameter Q2 for the inter macroblock is fixed at 

when the second quantization parameter Q2 is less than 

and more than or equal to 

Here, m is a natural numbers. On the other hand, the second quantization parameter Q2 for the intra macroblock 
is fixed at M 2mxQ1" when the second quantization parameter Q2 is less than 

and more than or equal to "2mxQ1". 

[0172] On the basis of the above theory, the quantization parameter calculator 412 is operated to compute the 
second quantization parameter Q2 in accordance with the following equations (65) and (66) depending on th 
types of macroblocks: 

where the equation (65) is used for the inter macroblock, while the equation (66) is used for the intra macroblock. 
[0173] The operation of the transcoder 400 will be described hereinlater. 

[0174] When the first quantization parameter Q1 (j) for the intra macroblock is 4 and the re-quantization parameter 
Q(j) is assumed to be 15 by the rate controller 410, the quantization parameter calculator 412 is operated to 
compute the second quantization parameter Q2(j) of 8 in accordance with the above equation (65). When the re- 
quantization parameter QG) is assumed to be 14, 13, 12, 11, 10, or 9, the quantization parameter calculator 412 is 
also operated to compute the second quantization parameter Q2(j) of 8 in accordance with the above equation 
(65). 

[0175] As shown in FIG. 8, when the first quantization parameter Q1(j) is 4, the same reduced information volume 
Rred can be obtained by the some re-quantization parameters Q(j) on the vertical line areas W1, i.e., 8 to 15. 
When the second quantization parameter Q2(j) is 8, which is represented by the point TQ8, the lowest average 
quantization error Dmin could be obtained. Consequently, the present invention can achieve the low average 
quantization error and larger reduced information volume. 



* [0176] The fifth embodiment of the transcoder 400 thus constructed can compute the appropriate re-quantization 
parameter on the basis of the de-quantization parameter with taking account of the rate distortion performance in 
converting the quantization level. Furthermore, the fifth embodiment of the transcoder 400 can reduce the 
quantization error even if the reduced information volume is increased. As a result, it is possible for any coded 
moving picture sequence signals and any types of pictures to achieve the appropriate rate control. 

[0177] Referring now to FIG. 10 of the drawings, there is shown a sixth preferred embodiment of the apparatus for 
transcoding the coded moving picture sequence according to the present invention as a transcoder 500. 

[0178] The transcoder 500 of this embodiment comprises a rate controller 510, a quantization parameter 
calculator 512, referred to as "Q calculator" in FIG. 10, and the same constitutional elements as those of the 
conventional transcoder 90 shown in FIG. 19 except for the rate controller 59. These same constitutional 
elements are simply represented by the same reference numerals as those of the conventional transcoder 90 
shown in FIG. 19, and will be thus omitted from description for avoiding tedious repetition. 

[0179] The rate controller 510 is electrically connected to the level converter 91 and designed to input, from the 
level converter 91, the information necessary to perform the rate control over the quantization level conversion in 
the level converter 91. The rate controller 510 is designed to compute and output the re-quantization parameter, 
referred to as "Q(j)'\ for each of the macroblocks MB(j) to the quantization parameter calculator 512. 

[0180] The quantization parameter calculator 512 is electrically connected to the variable length decoder 51 and 
designed to input the first quantization parameter Q1(j) for each of macroblocks MB(j) from the variable length 
decoder 51 . The quantization parameter calculator 512 is further electrically connected to the rate controller 510 
and designed to input the re-quantization parameter Q(j) for each of macroblocks MB(j) from the rate controller 
510. The quantization parameter calculator 512 is further designed to calculate the second quantization 
parameter Q2(j) for each of macroblocks MB(j) by correcting the re-quantization parameter Q(j) on the basis of the 
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Q2 as shown in FIG. 11. Particularly, the plots are liable to concentrate at a specific point having the larger 
second quantization parameter Q2. Namely, the difference in the relationship between the reduced information 
volume and the average quantization error D becomes smaller with respect to the second quantization parameter 
Q2, as the second quantization parameter Q2 becomes smaller. This results in the fact that the characteristic in 
the rate-distortion performance in converting the quantization levels is constant over most of the second 
quantization parameters Q2. 

[0190] The characteristic in the rate-distortion performance in converting the quantization levels has some turning 
points, for example, "TQ8" and "TQ16", derived by the following equations (69) and (70): 

where the equation (69) is used for the inter macroblock, while the equation (70) is used for the intra macroblock. 

[0191] As shown in FIG. 1 1 , there are some vertical line areas in the stepped waveforms wherein the reduced 
information volume Rred is constant. The first quantization parameter Q1 is equal to 4, and the reduced 
information volume Rred is nearly equal to 1.32 within the vertical line area W2. The average quantization error D 
can have individual values respectively corresponding to the individual second quantization parameters Q2 the 
within the vertical line area W2. One of the second quantization parameter Q2 corresponding to the minimum 
average quantization error Dmin may be preferably selected from among a plurality of values within the vertical 
line area W2. 

[0192] In order to select the above appropriate value of the second quantization parameter Q2, the second 
quantization parameter Q2 for the inter macroblock is fixed at 

when the second quantization parameter Q2 is less 

than and more than or equal to 

Here, m is a natural numbers. On the other hand, the second quantization parameter Q2 for the intra macroblock 
is fixed at 

when the second quantization parameter Q2 is less than or equal to 
and more than "2mxQ1". 

[0193] The sixth embodiment of the transcoder 500, for example, has the turning points TQ8 and TQ9 
corresponding to the second quantization parameters Q2 of "8" and "9", respectively, as shown in FIG. 11. On th 
other hand, the fifth embodiment of the transcoder 400, for example, has the turning points TQ7 and TQ8 
corresponding to the second quantization parameters Q2 of "7" and "8", as shown in FIG. 8. Thus, the sixth 
embodiment of the transcoder 500 has another characteristic in the rate-distortion performance in converting th 
quantization levels in compared with that of the fifth embodiment of the transcoder 400. It is therefore necessary 
for the sixth embodiment of the transcoder 500 to provide with the different quantization parameter calculator 512 
from the quantization parameter calculator 412 of the fifth embodiment of the transcoder 400 as described below. 

[0194] In the transcoder 500 of the sixth embodiment, the quantization parameter calculator 512 is operated to 
compute the second quantization parameter Q2 in accordance with the following equations (71) and (72) 
depending on the types of macroblocks: 



where the equation (71) is used for the inter macroblock, while the equation (72) is used for the intra macroblock. 
[0195] The operation of the transcoder 500 will be described hereinlater. 

[0196] When the first quantization parameter Q1(j) for the intra macroblock is 4 and the re-quantization parameter 
Q(j) is assumed to be 16 by the rate controller 510, the quantization parameter calculator 512 is operated to 
compute the second quantization parameter Q2G) of 9 in accordance with the above equation (69). When the 
second re-quantization parameter Q(j) is assumed to be 15, 14, 13, 12, 11, or 10, the quantization parameter 
calculator 512 is also operated to compute the second quantization parameter Q2(j) of 9 in accordance with the 
above equation (69). 

[0197] As shown in FIG. 1 1, when the first quantization parameter Q1(j) is 4, the same reduced information 
volume Rred can be obtained by the some re-quantization parameters Q(j) on the vertical line areas W2, i.e., 9 to 
16. When the second quantization parameter Q2(j) is 9, which is represented by the point TQ9, the lowest 
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average quantization error Dmin could be obtained. Consequently, the present invention can achieve the low 
average quantization error and larger reduced information volume. 

[0198] The experimental simulation test was conducted for the evaluation of the method and apparatus of this 
embodiment under the following condition. Two types of test sequences, such as "BUS sequence", and "Table 
Tennis sequence" were used for the test in order to verify that the method and apparatus of this embodiment is 
independent of the types of test sequences. The test sequences were coded by a typical encoder, not shown, to 
generate the first bit streams having a bit rate of 6, 9, 12 or 15Mbps to be input to the transcoder 500. The picture 
structure was assumed to be a frame structure. In this experimental simulation test, the number of frames was 
150. Each of the test sequences was coded into a MPEG-2 MP@ML format, having a number of pictures in 
GROUP OF PICUTRES N equals to 15, and an I or P-picture of M equals to 3, by a frame and field motion 
compensation method. In the test sequences, an image has an International Telegraph Union 
Radiocommunication Section (ITU-R) recommendation BT.601 4:2:0 format: 704pelsx480lines brightness signals; 
and 352pelsx240lines color difference signals. 

[0199] The input bit streams were transcoded to change from the original bit rate in the input bit streams to a 
target bit rate of 5Mbps in the output bit steams. A comparative experimental simulation test was conducted 
without selecting appropriate reference quantization parameter. 

[0200] According to the experimental simulation test results, the S/N ratio value in the output bit streams obtained 
by the transcoder 500 of this embodiment can be effectively increased in comparison with the conventional 
transcoder. In particular, the S/N ratio value in the output bit streams obtained by the transcoder 500 of this 
embodiment could be improved, as the bit rate of the input bit streams becomes lower. Namely, the method 
according to the present invention is effective for the input bit streams having the lower bit rate in improving its 
S/N ratio value. 

[0201] Furthermore, it will be understood from the experimental simulation test results that the most improvem nt 
of the S/N ratio could be achieved in the l-picture. This effect was produced by performing the rate control on the 
basis of the characteristic in the rate-distortion performance in converting the quantization levels represented by 
stepped waveforms in the inter macroblocks as shown in FIG. 11. 

[0202] As shown in FIG. 1 1 , the smaller first quantization parameter Q1 causes the sharper variation in the 
characteristic in the rate-distortion performance in converting the quantization levels in comparison with the larger 
first quantization parameter Q1 . This means that the method according to the present invention, in which the re- 
quantization parameter Q2 can be selected appropriately, is effective in transcoding the input bit streams having 
lower bit rate because of the fact that the input bit streams having the lower bit rate has the larger the first 
quantization parameter Q1 to cause the sharper variation in the characteristic in the rate-distortion performance in 
converting the quantization levels. 

[0203] The sixth embodiment of the transcoder 500 thus constructed can compute the appropriate re-quantization 
parameter on the basis of the de-quantization parameter with taking account of the rate distortion performance in 
converting the quantization level. Furthermore, the sixth embodiment of the transcoder 500 can reduce the 
quantization error as well as to increase the reduced information volume, thereby making it possible to achieve 
the effective rate control. 
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1. A method of transcoding a coded moving picture sequence, comprising the steps of: 

(a) inputting a first coded moving picture sequence signal (b1) at an input bit rate (lnput_Bitrate), said first coded 
moving picture sequence signal (b1) consisting of a series of pictures (pic(n)); 

(b) computing an estimated number of inputting bits to be input in said inputting step (a) for a predetermined 
duration (Ta) on the basis of said input bit rate (lnput_Bitrate) of said first coded moving picture sequence signal 
(b1); 

(c) decoding said first coded moving picture sequence signal (b1) inputted in said inputting step (a) to reconstruct 
an original picture data, for each of said pictures (pic(n)), having a number of real inputting bits (Sin(n)); 

(d) computing, for each of said pictures (pic(n)), a remaining number of inputting bits (Rin(n)) after the previous 
picture (pic(n-1)) in said first coded moving picture sequence signal (b1) is decoded in said decoding step (c) on 
the basis of said number of real inputting bits (Sin(n-1 )) of said previous picture (pic(n-1 )) and said estimated 
number of inputting bits obtained in said computing step (b); 

(e) transforming, on the basis of a scaling factor (Q(j), Q2(j), QM), said original picture data reconstructed in said 
decoding step (c) for each of said pictures (pic(n)) into an objective picture data having a number of real 
outputting bits (Sout(n)) less than said number of real inputting bits (Sin(n)) of said original picture data; 

(f) encoding said objective picture data obtained in said transforming step (e) to generate a second coded moving 
picture sequence signal (b2); 

(g) outputting said second coded moving picture sequence signal (b2) generated in said encoding step (f) at a 
target bit rate (Target_Bitrate) lower than said input bit rate (lnput_Bitrate) of said first coded moving picture 
sequence signal (b1); 

(h) computing an estimated number of outputting bits to be output in said outputting step (g) for said 
predetermined duration (Ta) on the basis of said target bit rate (TargetJ3itrate) of said second coded moving 
picture sequence signal (b2); 

(i) computing, for each of said pictures (pic(n)), a remaining number of outputting bits (Rout(n)) after said previous 
picture (pic(n-1)) in said second coded moving picture sequence signal (b2) is encoded in said encoding st p (f) 
on the basis of said number of real outputting bits (Sout(n-1)) of said previous picture (pic(n-1)) and said 
estimated number of outputting bits obtained in said computing step (h); 

(j) computing, for each of said pictures (pic(n)), a target ratio (ioRatio(n)) of said remaining number of outputting 
bits (Rout(n)) computed in said computing step (i) to said remaining number of inputting bits (Rin(n)) computed in 
said computing step (d) before the present picture (pic(n)) is transformed in said transforming step (e); and 
(k) computing said scaling factor (Q(j), Q2(j), QM) on the basis of said target ratio (ioRatio(n)) computed in said 
target ratio computing step (j) to control said target bit rate (TargeLBitrate) of said second coded moving picture 
sequence signal (b2). 



2. The method as set forth in claim 1 , wherein said computing step (d) comprising the steps of: 

(d1) initializing said remaining number of inputting bits (Rin(n)) of said current picture (pic(n)) on the basis of said 
estimated number of inputting bits; 

(d2) updating said remaining number of inputting bits (Rin(n)) of said current picture (pic(n)) on the basis of said 
number of real inputting bits (Sin(n-1)) of the previous picture (pic(n-1)) and said remaining number of inputting 
bits (Rin(n-1)) of the previous picture (pic(n-1)); 
(d3) repeating said step (d2) for each of said pictures (pic(n)); and 

(d4) repeating said steps (d1) and (d3) at time intervals of said predetermined duration (Ta), and 
said computing step (h) further comprising the steps of: 

(hi) initializing said remaining number of outputting bits (Rout(n)) of said current picture (pic(n)) on the basis of 
said estimated number of outputting bits; 

(h2) updating said remaining number of outputting bits (Rout(n)) of said current picture (pic(n)) on the basis of 

said number of real outputting bits (Sout(n-1)) of the previous picture (pic(n-1)) and said remaining number of 

outputting bits (Rout(n-1)) of the previous picture (pic(n-1)); 

(h3) repeating the step (h2) for each of said pictures (pic(n)); and 

(h4) repeating the steps (hi) and (h3) at time intervals of said predetermined duration (Ta). 

3. The method as set forth in claim 1 , further comprising the step of repeating said steps (b), (d), (h) and (i) for 
each of said pictures (pic(n)). 
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4. The method as set forth in claim 1 , wherein each of said pictures (pic(n)) consists of a plurality of blocks (MB 

(j)). 

said decoding step (c) further having the step of deriving an original scaling factor (Q1(j), QM) from said first 

coded moving picture sequence signal (b1), 

said transforming step (e) further comprising the steps of: 

(e1) dividing said original picture data for each of said picture (pic(n)) into a plurality of block data respectively 
corresponding to said blocks (MBQ)); 

(e2) quantizing said block data for each of said blocks (MB(j)) with said scaling factor (Q(j), Q2(j), QM); and 
(e3) repeating said steps (ei ) and (e2) for each of said blocks (MBQ)) within said picture (pic(n)) to generat said 
objective picture data; 

said step (k) having the step of updating said scaling factor (Q(j), Q2(j), QM) on the basis of said original scalina 
factor (Q1G), QM). a 



5. A method of transcoding a coded moving picture sequence, comprising the steps of: 

(a) inputting a first coded moving picture sequence signal (b1) at an input bit rate (lnput_Bitrate), said first coded 
moving picture sequence signal (b1 ) consisting of a series of pictures (pic(n)); 

(b) decoding said first coded moving picture sequence signal (b1) inputted in said inputting step (a) to reconstruct 
an original picture data, for each of said pictures (pic(n)), having a number of real inputting bits (Sin(n)), and 
derive an original scaling factor (Q1(j), QM); 

(c) transforming, on the basis of a scaling factor (Q2(j), QM), said original picture data reconstructed in said 
decoding step (b) for each of said pictures (pic(n)) into an objective picture data having a number of real 
outputting bits (Sout(n)) less than said number of real inputting bits (Sin(n)) of said original picture data; 

(d) encoding said objective picture data obtained in said transforming step (c) to generate a second coded moving 
picture sequence signal (b2); 

(e) outputting said second coded moving picture sequence signal (b2) generated in said encoding step (d) at a 
target bit rate (Target_Bitrate) lower than said input bit rate (lnput_Bitrate) of said first coded moving picture 
sequence signal (b1); 

(f) computing a temporary scaling factor (Q(j), QM) on the basis of said reconstructed original picture data to 
control said target bit rate (Target_Bitrate) of said second coded moving picture sequence signal (b2); and 

(g) correcting said temporary scaling factor (Q(j), QM) computed in said computing step (f) on the basis of said 
original scaling factor (Q1Q), QM) to derive said scaling factor (Q2(j), QM) for said transforming step (c). 



6. An apparatus (100: 200: 300: 400: 500) for transcoding a coded moving picture sequence, interposed between 
a first transmitting path and a second transmitting path, comprising: 

inputting means (a1) for inputting a first coded moving picture sequence signal (b1) through said first transmitting 
path at an input bit rate (lnput_Bitrate), said first coded moving picture sequence signal (b1) consisting of a series 
of pictures (pic(n)); 

decoding means (51) for decoding said first coded moving picture sequence signal (b1) inputted through said 
inputting means (a1) to reconstruct an original picture data, for each of said pictures (pic(n)), having a number of 
real inputting bits (Sin(n)); 

transforming means (53, 55: 91) for transforming, on the basis of a scaling factor (Q(j), Q2(j), QM), said original 
picture data reconstructed by said decoding means (51) for each of said pictures (pic(n)) into an objective picture 
data having a number of real outputting bits (Sout(n)) less than said number of real inputting bits (Sin(n)) of said 
original picture data; 

encoding means (57) for encoding said objective picture data obtained by said transforming means (53, 55: 91) to 
generate a second coded moving picture sequence signal (b2); 

outputting means (a2) for outputting said second coded moving picture sequence signal (b2) generated by said 
encoding means (57) through said second transmitting path at a target bit rate (Target_Bitrate) lower than said 
input bit rate (lnput_Bitrate) of said first coded moving picture sequence signal (b1); and 
rate controlling means (110: 210: 310: 410: 510) for controlling said target bit rate (Target_Bitrate) of said second 
coded moving picture sequence signal (b2), having: 

(a) a remaining bit computing unit (101) for computing: 

an estimated number of inputting bits to be input through said inputting means (a1) for a predetermined duration 
(Ta) on the basis of said input bit rate (lnputJ3itrate) of said first coded moving picture sequence signal (b1); 
a remaining number of inputting bits (Rin(n)) for each of said pictures (pic(n)) in said first coded moving picture 



http://12.espacenetxom/espacenet/claims?LG=en&CY=ep&DB=EPD&PNP=EP10 9/4/200: 



esp@cenet - Document Claims 



Page 3 of 6 



sequence signal (b1) on the basis of said number of real inputting bits (Sin(n)) of the current picture (pic(n)) and 
said estimated number of inputting bits; 

an estimated number of outputting bits to be output through said outputting means (a2) for said predetermined 
duration (Ta) on the basis of said target bit rate (Target_Bitrate) of said second coded moving picture sequence 
signal (b2); and 

a remaining number of outputting bits (Rout(n)) for each of said pictures (pic(n)) in said second coded moving 
picture sequence signal (b2) on the basis of said number of real outputting bits (Sout(n)) of the current picture (pic 
(n)) and said estimated number of outputting bits; 

(b) a target ratio computing unit (103: 303) for computing, for each of said pictures (pic(n)), a target ratio (ioRatio 
(n)) of said remaining number of outputting bits (Rout(n)) computed by said remaining bit computing unit (101) to 
said remaining number of inputting bits of said picture (Rin(n)) computed by said remaining bit computing unit 
(101); and 

(c) a scaling factor computing unit (105, 107) for computing said scaling factor (Q(j), Q2Q), QM) on the basis of 
said target ratio (ioRatio(n)) computed by said target ratio computing unit (103) to control said target bit rate 
(Target_Bitrate) of said second coded moving picture sequence signal (b2). 



7. The apparatus (100: 200: 300: 400: 500) as set forth in claim 6, further comprising controlling means (109) for 
operating said remaining bit computing unit (101) to: 

update, for each of said pictures (pic(n)), said remaining number of inputting bits (Rin(n)) of the current picture (pic 
(n)) on the basis of said number of real inputting bits (Sin(n-1 )) of the previous picture (pic(n-1 )) and said 
remaining number of inputting bits (Rin(n-1)) of the previous picture (pic(n-1)); 

update, for each of said pictures (pic(n)), said remaining number of outputting bits (Rout(n)) of the current picture 

(pic(n)) on the basis of said number of real outputting bits (Sout(n-1)) of the previous picture (pic(n-1)) and said 

remaining number of outputting bits (Rout(n-1)) of the previous picture (pic(n-1)); 

initialize said remaining number of inputting bits (Rin(n)) of the current picture (pic(n)) on the basis of said 

estimated number of inputting bits at time intervals of said predetermined duration (Ta); and 

initialize said remaining number of outputting bits (Rout(n)) of the current picture (pic(n)) on the basis of said 

estimated number of outputting bits at time intervals of said predetermined duration (Ta). 



8. The apparatus (200) as set forth in claim 6, further comprising controlling means (209) for operating said 
remaining bit computing unit (101) to compute: for each of said pictures (pic(n)), said estimated number of 
inputting bits; said remaining number of inputting bits (Rin(n)) of the current picture (pic(n)); said estimated 
number of outputting bits; and said remaining number of outputting bits (Rout(n)) of the current picture (pic(n)). 

9. The apparatus (300) as set forth in claim 6, wherein each of said picture (pic(n)) consists of a plurality of blocks 
(MB(j))i 

said decoding means (51) being further operated to derive an original scaling factor (Q1(j), QM) from said first 
coded moving picture sequence signal (b1), 

said transforming means (53, 55) being further operated to transform said original picture data for each of said 
picture (pic(n)) into a block data for each of said blocks (MB(j)), and 

said controlling means (110) being operated to update said scaling factor (Q(j), Q2(j), QM) on the basis of said 
original scaling factor (Q1G), QM). 



10. An apparatus (400: 500) for transcoding a coded moving picture sequence signal, interposed between a first 
transmitting path and a second transmitting path, comprising: 

inputting means (a1) for inputting a first coded moving picture sequence signal (b1) through said first transmitting 
path at an input bit rate (lnput_Bitrate), said first coded moving picture sequence signal (b1) consisting of a series 
of pictures (pic(n)); 

decoding means (51) for decoding said first coded moving picture sequence signal (b1) inputted through said 
inputting means (a1) to reconstruct an original picture data, for each of said pictures (pic(n)), having a number of 
real inputting bits (Sin(n)), and derive an original scaling factor (Q1 G), QM); 

transforming means (53, 55: 91) for transforming, on the basis of a scaling factor (Q2(j), QM), said original picture 
data reconstructed by said decoding means (51) for each of said pictures (pic(n)) into an objective picture data 
having a number of real outputting bits (Sout(n)) less than said number of real inputting bits (Sin(n)) of said 
original picture data; 
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encoding means (57) for encoding said objective picture data obtained by said transforming means (53, 55: 91) to 
generate a second coded moving picture sequence signal (b2); 

outputting means (a2) for outputting said second coded moving picture sequence signal (b2) generated by said 
encoding means (57) through said second transmitting path at a target bit rate (Target_Bitrate) lower than said 
input bit rate (lnput_Bitrate) of said first coded moving picture sequence signal (b1); 

rate controlling means (410: 510) for controlling said target bit rate (Target_Bitrate) of said second coded moving 
picture sequence signal (b2) by computing a temporary scaling factor (Q(j), QM) on the basis of said 
reconstructed original picture data; and 

correcting means (412: 512) for correcting said temporary scaling factor (Q(j), QM) computed by said rate 
controlling means (410: 510) on the basis of said original scaling factor (Q1(j), QM) to derive said scaling factor 
(Q2(j), QM) for transforming means (53, 55: 91). 

1 1. A computer program product comprising a computer usable storage medium having computer readable code 
embodied therein for transcoding a coded moving picture sequence signal, said computer readable code 
comprising: 

(a) computer readable program code for inputting a first coded moving picture sequence signal (b1) at an input bit 
rate (input_Bitrate), said first coded moving picture sequence signal (b1 ) consisting of a series of pictures (pic(n)); 

(b) computer readable program code for computing an estimated number of inputting bits to be input by said 
computer readable program code (a) for a predetermined duration (Ta) on the basis of said input bit rate 
(lnput_Bitrate) of said first coded moving picture sequence signal (b1); 

(c) computer readable program code for decoding said first coded moving picture sequence signal (b1) inputted 
by said computer readable program code (a) to reconstruct an original picture data, for each of said pictures (pic 
(n)), having a number of real inputting bits (Sin(n)); 

(d) computer readable program code for computing, for each of said pictures (pic(n)), a remaining number of 
inputting bits (Rin(n)) after the previous picture (pic(n-1)) in said first coded moving picture sequence signal (b1) is 
decoded by said computer readable program code (c) on the basis of said number of real inputting bits (Sin(n-1)) 
of said previous picture (pic(n-1)) and said estimated number of inputting bits obtained by said computer readable 
program code (b); 

(e) computer readable program code for transforming, on the basis of a scaling factor (Q(j), Q2(j), QM), said 
original picture data reconstructed by said computer readable program code (c) for each of said pictures (pic(n)) 
into an objective picture data having a number of real outputting bits (Sout(n)) less than said number of real 
inputting bits (Sin(n)) of said original picture data; 

(f) computer readable program code for encoding said objective picture data obtained by said computer readable 
program code (e) to generate a second coded moving picture sequence signal (b2); 

(g) computer readable program code for outputting said second coded moving picture sequence signal (b2) 
generated by said computer readable program code (f) at a target bit rate (Target_Bitrate) lower than said input 
bit rate (lnput_Bitrate) of said first coded moving picture sequence signal (b1); 

(h) computer readable, program code for computing an estimated number of outputting bits to be output by said 
computer readable program code (g) for said predetermined duration (Ta) on the basis of said target bit rate 
(TargetJJitrate) of said second coded moving picture sequence signal (b2); 

(i) computer readable program code for computing, for each of said pictures (pic(n)), a remaining number of 
outputting bits (Rout(n)) after said previous picture (pic(n-l)) in said second coded moving picture sequence 
signal (b2) is encoded by said computer readable program code (f) on the basis of said number of real outputting 
bits (Sout(n-1 )) of said previous picture (pic(n-1 )) and said estimated number of outputting bits obtained by said 
computer readable program code (h); 

(j) computer readable program code for computing, for each of said pictures (pic(n)), a target ratio (ioRatio(n)) of 
said remaining number of outputting bits (Rout(n)) computed by said computer readable program code (i) to said 
remaining number of inputting bits (Rin(n)) computed by said computer readable program code (d) before the 
present picture (pic(n)) is transformed by said computer readable program code (e); and 
(k) computer readable program code for computing said scaling factor (Q(j), Q2(j), QM) on the basis of said target 
ratio (ioRatio(n)) computed by said computer readable program code (j) to control said target bit rate 
(Target_Bitrate) of said second coded moving picture sequence signal (b2). 

12. The computer program product as set forth in claim 11, wherein said computer readable program code (d) 
has: 

(d1) computer readable program code for initializing said remaining number of inputting bits (Rin(n)) of said 
current picture (pic(n)) on the basis of said estimated number of inputting bits; 

(d2) computer readable program code for updating said remaining number of inputting bits (Rin(n)) of said current 
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picture (pic(n)) on the basis of said number of real inputting bits (Sin(n-1)) of the previous picture (pic(n-1)) and 
said remaining number of inputting bits (Rin(n-1 )) of the previous picture (pic(n-1 )); 

(d3) computer readable program code for repeating said computer readable program code (d2) for each of said 
pictures (pic(n)); and 

(d4) computer readable program code for repeating said computer readable program codes (d1) and (d3) at time 

intervals of said predetermined duration (Ta), and 

said computer readable program code (h) further comprising: 

(hi ) computer readable program code for initializing said remaining number of outputting bits (Rout(n)) of said 
current picture (pic(n)) on the basis of said estimated number of outputting bits; 

(h2) computer readable program code for updating said remaining number of outputting bits (Rout(n)) of said 
current picture (pic(n)) on the basis of said number of real outputting bits (Sout(n-1)) of the previous picture (pic(n- 
1)) and said remaining number of outputting bits (Rout(n-1)) of the previous picture (pic(n-1)); 
(h3) computer readable program code for repeating said computer readable program code (h2) for each of said 
pictures (pic(n)); and 

(h4) computer readable program code for repeating said computer readable program codes (hi) and (h3) at time 
intervals of said predetermined duration (Ta). 



13. The computer program product as set forth in claim 11, further comprising computer readable program code 
for repeating said computer readable program codes (b), (d), (h) and (i) for each of said pictures (pic(n)). 

14. The computer program product as set forth in claim 1 1 , wherein each of said pictures (pic(n)) consists of a 
plurality of blocks (MB(j)), 

said computer readable program code (c) further having computer readable program code for deriving an original 
scaling factor (Q1(j), QM) from said first coded moving picture sequence signal (b1), 
said computer readable program code (e) further comprising: 

(e1) computer readable program code for dividing said original picture data for each of said picture (pic(n)) into a 
plurality of block data respectively corresponding to said blocks (MB(j)); 

(e2) computer readable program code for quantizing said block data for each of said blocks (MB(j)) with said 
scaling factor (Q(j), Q2(j), QM); and 

(e3) computer readable program code for repeating said computer readable program codes (e1) and (e2) for each 
of said blocks (MB(j)) within said picture (pic(n)) to generate said objective picture data; 

said computer readable program code (k) having computer readable program code for updating said scaling 
factor (Q(j), Q2(j), QM) on the basis of said original scaling factor (Q1(j), QM). 

15. A computer program product comprising a computer usable storage medium having computer readable code 
embodied therein for transcoding a coded moving picture sequence signal, said computer readable code 
comprising: 

(a) computer readable program code for inputting a first coded moving picture sequence signal (b1) at an input bit 
rate (lnput_Bitrate), said first coded moving picture sequence signal (b1) consisting of a series of pictures (pic(n)); 

(b) computer readable program code for decoding said first coded moving picture sequence signal (b1) inputted 
by said computer readable program code (a) to reconstruct an original picture data, for each of said pictures (pic 
(n)) ( having a number of real inputting bits (Sin(n)), and derive an original scaling factor (Q1(j). QM); 

(c) computer readable program code for transforming, on the basis of a scaling factor (Q2(j), QM), said original 
picture data reconstructed by said computer readable program code (b) for each of said pictures (pic(n)) into an 
objective picture data having a number of real outputting bits (Sout(n)) less than said number of real inputting bits 
(Sin(n)) of said original picture data; 

(d) computer readable program code for encoding said objective picture data obtained by said computer readable 
program code (c) to generate a second coded moving picture sequence signal (b2); 

(e) computer readable program code for outputting said second coded moving picture sequence signal (b2) 
generated by said computer readable program code (d) at a target bit rate (Targe_Bitrate) lower than said input 
bit rate (lnput_Bitrate) of said first coded moving picture sequence signal (b1); 

(f) computer readable program code for computing a temporary scaling factor (Q(j), QM) on the basis of said 
reconstructed original picture data to control said target bit rate (Target_Bitrate) of said second coded moving 
picture sequence signal (b2); and 

(g) computer readable program code for correcting said temporary scaling factor (Q(j), QM) computed by said 
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computer readable program code (f) on the basis of said original scaling factor (Q1(j), QM) to derive said scalina 
factor (Q2(j), QM) for said computer readable program code (c). 
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